[ 514.385421] env[65651]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 514.385421] env[65651]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 515.435813] env[65738]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 515.435813] env[65738]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 517.000864] env[65738]: INFO neutron.common.config [-] Logging enabled! [ 517.001282] env[65738]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev7 [ 517.001431] env[65738]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65738) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 517.001724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 517.001903] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 517.002686] env[65738]: WARNING oslo_policy.policy [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 517.002896] env[65738]: WARNING oslo_policy.policy [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 517.004588] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] VMware NSXv3 Agent initialized successfully. [ 517.004942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Acquiring lock "singleton_lock" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.005088] env[65738]: DEBUG oslo_concurrency.lockutils [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Acquired lock "singleton_lock" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.005281] env[65738]: DEBUG oslo_concurrency.lockutils [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Releasing lock "singleton_lock" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.005569] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Full set of CONF: {{(pid=65738) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 517.005680] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ******************************************************************************** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 517.005792] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Configuration options gathered from: {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 517.006132] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 517.006301] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 517.006406] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ================================================================================ {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 517.006573] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] agent_down_time = 75 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.006710] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] allow_automatic_dhcp_failover = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.006842] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] allow_bulk = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.006982] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] api_extensions_path = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007131] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] api_paste_config = api-paste.ini {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007268] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] auth_strategy = keystone {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007373] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] backdoor_port = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007460] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] backdoor_socket = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007591] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] backlog = 4096 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007724] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] base_mac = fa:16:3e:00:00:00 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.007875] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] bind_host = 0.0.0.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008018] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] bind_port = 9696 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008145] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] client_socket_timeout = 900 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008285] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] config_dir = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008391] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008525] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] config_source = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008660] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] control_exchange = neutron {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008793] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] core_plugin = ml2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.008926] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] debug = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009068] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] default_availability_zones = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009272] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009405] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dhcp_agent_notification = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009535] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dhcp_agents_per_network = 1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009664] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dhcp_lease_duration = 86400 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009834] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dhcp_load_type = networks {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.009940] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dns_domain = openstacklocal {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010085] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010216] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_default_route_bfd = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010345] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_default_route_ecmp = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010470] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_dvr = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010601] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_new_agents = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010723] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010845] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_signals = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.010969] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] enable_traditional_dhcp = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011099] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] external_dns_driver = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011222] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] filter_validation = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011356] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] global_physnet_mtu = 8950 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011481] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] graceful_shutdown_timeout = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011651] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] host = cpu-1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011784] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] host_dvr_for_dhcp = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.011912] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] http_retries = 3 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012052] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] instance_format = [instance: %(uuid)s] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012185] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012316] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ipam_driver = internal {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012475] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ipv6_pd_enabled = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012567] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] l3_ha = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012698] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012829] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] l3_ha_network_physical_name = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.012957] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] l3_ha_network_type = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013107] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_color = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013238] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_config_append = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013371] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013497] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_dir = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013622] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_file = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013720] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_options = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013887] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_rotate_interval = 1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.013979] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_rotate_interval_type = days {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014122] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] log_rotation_type = none {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014223] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014321] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014455] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014589] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014686] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014813] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_dns_nameservers = 5 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.014939] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_header_line = 16384 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015078] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_l3_agents_per_router = 3 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015205] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_logfile_count = 30 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015330] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_logfile_size_mb = 200 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015454] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] max_subnet_host_routes = 20 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015587] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] my_ip = 10.180.1.21 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015717] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] my_ipv6 = ::1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015843] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] network_auto_schedule = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.015964] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] network_link_prefix = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016107] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016243] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] notify_nova_on_port_data_changes = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016381] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] notify_nova_on_port_status_changes = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016511] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] pagination_max_limit = -1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016638] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] publish_errors = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016763] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rate_limit_burst = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.016897] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rate_limit_except_level = CRITICAL {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017032] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rate_limit_interval = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017161] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] retry_until_window = 30 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017288] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] router_distributed = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017414] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rpc_resources_processing_step = 20 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017547] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rpc_response_max_timeout = 600 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017678] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] rpc_response_timeout = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017799] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] send_events_interval = 2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.017941] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] service_plugins = ['router'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018083] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] setproctitle = on {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018206] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] shell_completion = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018339] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] state_path = /opt/stack/data/neutron {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018470] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] syslog_log_facility = LOG_USER {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018598] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] tcp_keepidle = 600 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018728] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] transport_url = **** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018856] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] use_journal = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.018984] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] use_json = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019120] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] use_ssl = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019245] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] use_stderr = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019381] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] use_syslog = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019508] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vlan_qinq = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019631] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vlan_transparent = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019757] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] watch_log_file = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.019887] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] wsgi_default_pool_size = 100 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.020048] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] wsgi_keep_alive = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.020148] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.020275] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] wsgi_server_debug = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 517.020420] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_concurrency.disable_process_locking = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.020558] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.020695] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.020825] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.020964] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021109] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021242] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021391] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.connection_string = messaging:// {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021532] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.enabled = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021670] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.es_doc_type = notification {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021801] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.es_scroll_size = 10000 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.021945] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.es_scroll_time = 2m {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022092] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.filter_error_trace = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022230] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.hmac_keys = **** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022368] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.sentinel_service_name = mymaster {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022524] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.socket_timeout = 0.1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022650] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.trace_requests = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022781] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler.trace_sqlalchemy = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.022927] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler_jaeger.process_tags = {} {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.023067] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler_jaeger.service_name_prefix = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.023201] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] profiler_otlp.service_name_prefix = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.023349] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.enforce_new_defaults = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.023634] env[65738]: WARNING oslo_config.cfg [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 517.023782] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.enforce_scope = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.023929] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.policy_default_rule = default {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024081] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024223] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024362] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024520] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024632] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024760] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.024889] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025034] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_policy.remote_timeout = 60.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025182] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025323] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] agent.extensions = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025464] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025607] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] service_providers.service_provider = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025747] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.default_quota = -1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.025886] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026026] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_floatingip = 50 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026160] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_network = 100 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026293] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_port = 500 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026425] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026566] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_router = 10 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026673] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_security_group = 10 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026807] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.026938] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.quota_subnet = 100 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027095] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] QUOTAS.track_quota_usage = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027218] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027347] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027474] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027607] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027740] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027871] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.027996] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028142] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028268] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028391] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028520] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028651] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028778] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.028902] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_dhcp_release.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029045] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029172] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029296] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029424] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029555] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029685] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029812] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_ovs_vsctl.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.029947] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.capabilities = [21] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030125] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030196] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030321] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030454] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030587] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030710] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_namespace.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030843] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.capabilities = [12] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.030967] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031101] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031227] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031358] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031488] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031616] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_conntrack.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031750] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.capabilities = [12, 21] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031872] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.group = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.031994] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.helper_command = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032135] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.log_daemon_traceback = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032267] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032397] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.thread_pool_size = 8 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032522] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] privsep_link.user = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032674] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032815] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.032948] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.continue_on_failed_promotions = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033091] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.dscp = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033221] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.dscp_inherit = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033357] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.force_mp_to_policy = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033488] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.locking_coordinator_url = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033622] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.log_agent_heartbeats = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033752] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.logging_expire = 1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.033885] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034033] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034191] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.polling_interval = 240 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034309] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034448] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034589] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.report_interval = 30.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034728] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.034866] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035018] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035152] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.sync_skew = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035286] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.synchronization_queue_size = 20 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035420] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT.use_helper_for_ns_read = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035562] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] SECURITYGROUP.enable_ipset = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035703] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] SECURITYGROUP.enable_security_group = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035838] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.035974] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036127] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] experimental.ipv6_pd_enabled = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036287] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.extension_drivers = ['port_security'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036418] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.external_network_type = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036565] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036707] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.overlay_ip_version = 4 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036847] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.path_mtu = 8950 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.036985] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.physical_network_mtus = {} {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037139] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.tenant_network_types = ['vlan'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037276] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037415] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ml2.type_drivers = ['vlan'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037558] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT_CLI.neutron_port_id = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037691] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037821] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.037964] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038119] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038260] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038400] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038539] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038681] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.038881] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039031] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_login_password = **** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039184] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_login_port = 443 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039322] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_login_user = admin {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039458] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039599] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039734] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.039863] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040020] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040168] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040372] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040477] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040566] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040691] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040836] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.040965] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041114] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041312] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041457] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vsphere.vsphere_login_password = VMware1! {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041600] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041742] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.041883] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.auth_section = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042032] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.auth_type = password {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042172] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042301] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.certfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042434] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.collect_timing = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042573] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.endpoint_type = public {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042706] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.insecure = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042835] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.keyfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.042972] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.region_name = RegionOne {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043113] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.split_loggers = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043242] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] nova.timeout = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043377] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.auth_section = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043521] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.auth_type = password {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043659] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043786] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.certfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.043916] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.collect_timing = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044062] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.endpoint_type = public {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044195] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.insecure = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044360] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.keyfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044431] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.region_name = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044561] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.split_loggers = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044687] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] placement.timeout = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044824] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.auth_section = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.044954] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.auth_type = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045089] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.cafile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045214] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.certfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045345] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.collect_timing = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045473] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.connect_retries = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045601] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.connect_retry_delay = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045731] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.enable_notifications = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045857] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.endpoint_override = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.045995] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.insecure = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046138] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.interface = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046264] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.keyfile = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046396] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.max_version = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046521] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.min_version = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046647] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.region_name = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046771] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.retriable_status_codes = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.046896] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.service_name = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047026] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.service_type = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047158] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.split_loggers = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047283] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.status_code_retries = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047408] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.status_code_retry_delay = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047534] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.timeout = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047661] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.valid_interfaces = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047792] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ironic.version = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.047932] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] cli_script.dry_run = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048089] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048227] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048363] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048495] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048629] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048758] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.048890] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049032] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049168] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049307] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049437] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049578] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049717] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049854] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.049989] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050141] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050272] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050473] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050553] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050672] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050804] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.050936] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051079] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051209] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051343] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051470] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051603] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051735] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051865] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.051996] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052142] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052281] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052416] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052616] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052699] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052837] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.ssl_version = {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.052968] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.053121] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_notifications.driver = [] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.053254] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_notifications.retry = -1 {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.053403] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.053531] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] oslo_messaging_notifications.transport_url = **** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 517.053636] env[65738]: DEBUG oslo_service.backend._eventlet.service [None req-45a5f4d3-26d5-4bef-b2e4-6d4941b9dc8a None None] ******************************************************************************** {{(pid=65738) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 517.054803] env[65738]: DEBUG neutron.agent.securitygroups_rpc [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Init firewall settings (driver=nsxv3) {{(pid=65738) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 517.056105] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65738) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 517.056351] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] RPC agent_id: nsxm-l-01a.corp.local [ 517.058577] env[65738]: DEBUG dogpile.cache.region [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 517.058696] env[65738]: DEBUG dogpile.lock [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 517.058796] env[65738]: DEBUG dogpile.lock [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 517.058887] env[65738]: DEBUG dogpile.lock [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 517.058981] env[65738]: DEBUG dogpile.cache.region [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 517.059082] env[65738]: DEBUG dogpile.lock [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 517.059204] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 517.080930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Session token - acquiring [ 517.082524] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.082722] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.083010] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.083237] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.095182] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.379962] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 517.399968] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 517.400171] env[65738]: DEBUG dogpile.cache.region [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 517.400300] env[65738]: DEBUG dogpile.lock [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 517.400367] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Activating Policy API Provider. [ 517.400545] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Looking for the default Infrastructure Rules. [ 517.465061] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Looking for the Default Layer3 Logged Drop Section. [ 517.479103] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 517.479581] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.479761] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.479837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.480114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.480483] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 517.994990] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 518.497819] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 519.000413] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Inventory metadata is going to be refreshed. [ 519.000682] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 519.743952] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.744406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.744406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.744601] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.755519] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 519.757540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.758192] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 519.776544] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.776869] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.776869] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.777169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.777290] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.777439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 519.777550] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.777653] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 519.797928] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.798174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.798174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.798427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.798592] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.798731] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 519.819254] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.819488] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.819530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.819902] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.820061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.820203] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 519.839359] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.839625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.839625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.839901] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.840042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.840191] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 519.840295] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.840397] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 519.859174] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.859381] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.859427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.859684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.859801] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.859936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 519.860046] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.860149] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 519.880274] env[65738]: DEBUG networking_nsxv3.common.locking [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.880509] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.880560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.880839] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.880979] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.881147] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 519.881244] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.881342] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Inventory metadata have been refreshed. [ 519.881438] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Dryrun:True. Metadata refresh completed. [ 519.881542] env[65738]: DEBUG oslo_concurrency.lockutils [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.883294] env[65738]: INFO neutron.agent.agent_extensions_manager [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Loaded agent extensions: [] [ 519.884046] env[65738]: DEBUG neutron_lib.callbacks.manager [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65738) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 519.935951] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent RPC Daemon Started! [ 519.936114] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:0 started [ 519.936220] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent out of sync with plugin! [ 524.885266] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 524.885643] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 529.887022] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 529.887491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.888576] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 534.888576] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.966763] env[65738]: INFO networking_nsxv3.common.synchronization [None req-116c0197-04ce-4fd6-8e06-52f2d4d54ada demo admin] Enqueued Resource ID: 9512bc3e-95aa-4660-b75a-2e235e41bb88 with Priority: HIGHEST for action security_group_rules [ 534.967279] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9512bc3e-95aa-4660-b75a-2e235e41bb88 with Priority: HIGHEST for action security_group_rules [ 534.969110] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9512bc3e-95aa-4660-b75a-2e235e41bb88 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.969268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9512bc3e-95aa-4660-b75a-2e235e41bb88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.969342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9512bc3e-95aa-4660-b75a-2e235e41bb88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.969804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9512bc3e-95aa-4660-b75a-2e235e41bb88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.969885] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9512bc3e-95aa-4660-b75a-2e235e41bb88',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.492134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.492134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.492134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.492134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.492134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.492134] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9512bc3e-95aa-4660-b75a-2e235e41bb88 already deleted. [ 535.492134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9512bc3e-95aa-4660-b75a-2e235e41bb88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.968831] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.968831] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.970093] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.970093] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.887527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.887994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.887994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.888116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.888338] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.390957] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.893161] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.970763] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.970933] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.394613] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 550.394853] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 551.119058] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.119467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.119467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.119539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.131828] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 551.132669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.133304] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 551.217117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.217357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.217357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.217583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.217670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.217783] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 551.217854] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 551.217925] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 551.238592] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.238866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.238866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.238987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.239107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.239218] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 551.261202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.261468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.261468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.261617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.261722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.261832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 551.281313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.281568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.281568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.281699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.281799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.281916] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 551.281990] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 551.282065] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 551.302749] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.302985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.302985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.303130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.303248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.303361] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 551.303405] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 551.303476] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 551.325326] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.325567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.325567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.325717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.325818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.325932] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 551.326014] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 551.326082] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 551.326149] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 551.326223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 551.326285] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 551.326343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 551.326629] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 551.326689] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 551.326758] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 551.355751] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.355964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.355964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.356194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.356307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.356418] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 551.381471] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.381697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.381697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.381834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.381936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.394419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.971626] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.971626] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.972355] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.972754] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.861720] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7783ee65-d586-4ac8-a121-7c5061209757 None None] Enqueued Resource ID: bea03b47-25e9-4bc2-b909-57da6aad9c14 with Priority: HIGHEST for action port [ 562.862098] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bea03b47-25e9-4bc2-b909-57da6aad9c14 with Priority: HIGHEST for action port [ 562.862913] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-bea03b47-25e9-4bc2-b909-57da6aad9c14 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.862913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bea03b47-25e9-4bc2-b909-57da6aad9c14" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.862913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bea03b47-25e9-4bc2-b909-57da6aad9c14" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.863368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bea03b47-25e9-4bc2-b909-57da6aad9c14" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.863453] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bea03b47-25e9-4bc2-b909-57da6aad9c14',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.365527] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bea03b47-25e9-4bc2-b909-57da6aad9c14 [ 563.365767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.365935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.366009] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.366239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.366330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.366423] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bea03b47-25e9-4bc2-b909-57da6aad9c14 already deleted. [ 563.366501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bea03b47-25e9-4bc2-b909-57da6aad9c14" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.659552] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d292e149-e236-4d2a-b06a-ee67090712db None None] Enqueued Resource ID: 031e1e1e-6b0a-4aa1-bda7-bc8377a00431 with Priority: HIGHEST for action port [ 564.660146] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 031e1e1e-6b0a-4aa1-bda7-bc8377a00431 with Priority: HIGHEST for action port [ 564.662403] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-031e1e1e-6b0a-4aa1-bda7-bc8377a00431 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.662403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-031e1e1e-6b0a-4aa1-bda7-bc8377a00431" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.662403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-031e1e1e-6b0a-4aa1-bda7-bc8377a00431" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.662403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-031e1e1e-6b0a-4aa1-bda7-bc8377a00431" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.662403] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('031e1e1e-6b0a-4aa1-bda7-bc8377a00431',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.164714] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 031e1e1e-6b0a-4aa1-bda7-bc8377a00431 [ 565.164956] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.165119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.165187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.165400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.165487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.165582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:031e1e1e-6b0a-4aa1-bda7-bc8377a00431 already deleted. [ 565.165658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-031e1e1e-6b0a-4aa1-bda7-bc8377a00431" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.769780] env[65738]: INFO networking_nsxv3.common.synchronization [None req-265ffbc6-b13d-43cb-a314-1fad6e6c2de7 None None] Enqueued Resource ID: 7a6ce2f9-9034-4166-9390-ebc18b78d2ed with Priority: HIGHEST for action port [ 566.770519] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6ce2f9-9034-4166-9390-ebc18b78d2ed with Priority: HIGHEST for action port [ 566.770900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a6ce2f9-9034-4166-9390-ebc18b78d2ed taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.771232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a6ce2f9-9034-4166-9390-ebc18b78d2ed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.771232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a6ce2f9-9034-4166-9390-ebc18b78d2ed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.771346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a6ce2f9-9034-4166-9390-ebc18b78d2ed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.771422] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a6ce2f9-9034-4166-9390-ebc18b78d2ed',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.879248] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3c6f4929-b9d6-40f7-b4aa-044a4a9133d9 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 566.879816] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 566.881294] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.882054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.882054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.882247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.882332] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.273917] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a6ce2f9-9034-4166-9390-ebc18b78d2ed [ 567.274228] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.275642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.275642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.275642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.275642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.275642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a6ce2f9-9034-4166-9390-ebc18b78d2ed already deleted. [ 567.275642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a6ce2f9-9034-4166-9390-ebc18b78d2ed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.329525] env[65738]: INFO networking_nsxv3.common.synchronization [None req-44d816cf-8ddd-4704-a357-234c7e0417b9 None None] Enqueued Resource ID: 9111deb7-4149-4099-98d6-a8095012d5b8 with Priority: HIGHEST for action port [ 567.330118] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9111deb7-4149-4099-98d6-a8095012d5b8 with Priority: HIGHEST for action port [ 567.330440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9111deb7-4149-4099-98d6-a8095012d5b8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.330575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9111deb7-4149-4099-98d6-a8095012d5b8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.330631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9111deb7-4149-4099-98d6-a8095012d5b8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.330862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9111deb7-4149-4099-98d6-a8095012d5b8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.330942] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9111deb7-4149-4099-98d6-a8095012d5b8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.413479] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.413684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.413732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.413959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.414072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.414159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 already deleted. [ 567.414242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.835127] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9111deb7-4149-4099-98d6-a8095012d5b8 [ 567.835127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.835127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.835127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.835127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.835127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.835127] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9111deb7-4149-4099-98d6-a8095012d5b8 already deleted. [ 567.835127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9111deb7-4149-4099-98d6-a8095012d5b8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.234743] env[65738]: INFO networking_nsxv3.common.synchronization [None req-91bdc01d-2f0a-484f-b648-aed7497e6876 None None] Enqueued Resource ID: 50e2535e-b83b-4a7c-afc5-568782afc33c with Priority: HIGHEST for action port [ 568.234743] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e2535e-b83b-4a7c-afc5-568782afc33c with Priority: HIGHEST for action port [ 568.234944] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-50e2535e-b83b-4a7c-afc5-568782afc33c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.235051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50e2535e-b83b-4a7c-afc5-568782afc33c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.235051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50e2535e-b83b-4a7c-afc5-568782afc33c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.235433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50e2535e-b83b-4a7c-afc5-568782afc33c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.235433] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50e2535e-b83b-4a7c-afc5-568782afc33c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.742186] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50e2535e-b83b-4a7c-afc5-568782afc33c [ 568.742186] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.742186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.742186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.742186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.742186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.742470] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50e2535e-b83b-4a7c-afc5-568782afc33c already deleted. [ 568.742470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50e2535e-b83b-4a7c-afc5-568782afc33c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.906789] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5185cabb-7dfd-4606-b47a-e62c5a5b23d5 None None] Enqueued Resource ID: 748a08cc-1e9c-4dc8-85fb-11e6cf705723 with Priority: HIGHEST for action port [ 568.907104] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 748a08cc-1e9c-4dc8-85fb-11e6cf705723 with Priority: HIGHEST for action port [ 568.907928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-748a08cc-1e9c-4dc8-85fb-11e6cf705723 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.907928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-748a08cc-1e9c-4dc8-85fb-11e6cf705723" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.907928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-748a08cc-1e9c-4dc8-85fb-11e6cf705723" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.908325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-748a08cc-1e9c-4dc8-85fb-11e6cf705723" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.908426] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('748a08cc-1e9c-4dc8-85fb-11e6cf705723',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.040038] env[65738]: INFO networking_nsxv3.common.synchronization [None req-fbc4fcdd-c5c7-4047-a2d4-4f1c34f79f5e tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 569.040713] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 569.041899] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.042113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.042329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.042407] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.413559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 748a08cc-1e9c-4dc8-85fb-11e6cf705723 [ 569.413559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.413559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.413559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.413559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.413559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.413559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:748a08cc-1e9c-4dc8-85fb-11e6cf705723 already deleted. [ 569.413559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-748a08cc-1e9c-4dc8-85fb-11e6cf705723" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.567822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.569211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.569303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.569460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.569550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.569649] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 already deleted. [ 569.569732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.581295] env[65738]: INFO networking_nsxv3.common.synchronization [None req-66cc5449-9a62-4951-be37-2bcdf70750fb None None] Enqueued Resource ID: 0eba8672-c021-43cd-ac12-10a1b929f41b with Priority: HIGHEST for action port [ 569.581644] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eba8672-c021-43cd-ac12-10a1b929f41b with Priority: HIGHEST for action port [ 569.582253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eba8672-c021-43cd-ac12-10a1b929f41b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.582919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eba8672-c021-43cd-ac12-10a1b929f41b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.582919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eba8672-c021-43cd-ac12-10a1b929f41b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.583253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eba8672-c021-43cd-ac12-10a1b929f41b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.583352] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eba8672-c021-43cd-ac12-10a1b929f41b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.921778] env[65738]: INFO networking_nsxv3.common.synchronization [None req-53e963ac-6993-4541-a5cf-9101bed740e7 None None] Enqueued Resource ID: 6be68d1d-002d-4f56-936c-071ed6cf857d with Priority: HIGHEST for action port [ 569.922263] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be68d1d-002d-4f56-936c-071ed6cf857d with Priority: HIGHEST for action port [ 569.922555] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be68d1d-002d-4f56-936c-071ed6cf857d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.922681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be68d1d-002d-4f56-936c-071ed6cf857d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.922832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be68d1d-002d-4f56-936c-071ed6cf857d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.922986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be68d1d-002d-4f56-936c-071ed6cf857d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.923349] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be68d1d-002d-4f56-936c-071ed6cf857d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.087205] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eba8672-c021-43cd-ac12-10a1b929f41b [ 570.087205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.087205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.087205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.087205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.087205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.087205] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eba8672-c021-43cd-ac12-10a1b929f41b already deleted. [ 570.087205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eba8672-c021-43cd-ac12-10a1b929f41b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.426597] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6be68d1d-002d-4f56-936c-071ed6cf857d [ 570.426929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.427126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.428448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.428448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.428448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.428448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6be68d1d-002d-4f56-936c-071ed6cf857d already deleted. [ 570.428448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be68d1d-002d-4f56-936c-071ed6cf857d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.793131] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d2a9a6af-d11d-47a4-9c43-0d1ee11f0967 None None] Enqueued Resource ID: c5afd9e2-23a6-47da-8638-304a82eddd7a with Priority: HIGHEST for action port [ 570.793804] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5afd9e2-23a6-47da-8638-304a82eddd7a with Priority: HIGHEST for action port [ 570.794141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5afd9e2-23a6-47da-8638-304a82eddd7a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.794266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5afd9e2-23a6-47da-8638-304a82eddd7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.794332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5afd9e2-23a6-47da-8638-304a82eddd7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.794591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5afd9e2-23a6-47da-8638-304a82eddd7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.794694] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5afd9e2-23a6-47da-8638-304a82eddd7a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.297217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5afd9e2-23a6-47da-8638-304a82eddd7a [ 571.297478] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.297478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.297478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.297696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.297785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.297879] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5afd9e2-23a6-47da-8638-304a82eddd7a already deleted. [ 571.297966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5afd9e2-23a6-47da-8638-304a82eddd7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.301287] env[65738]: INFO networking_nsxv3.common.synchronization [None req-f620cbf2-d0fe-4801-b7f2-9590179426a9 None None] Enqueued Resource ID: 0a360b32-986a-43fe-b7d2-e4a40786efea with Priority: HIGHEST for action port [ 572.302101] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a360b32-986a-43fe-b7d2-e4a40786efea with Priority: HIGHEST for action port [ 572.302568] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a360b32-986a-43fe-b7d2-e4a40786efea taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.302568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a360b32-986a-43fe-b7d2-e4a40786efea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.302694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a360b32-986a-43fe-b7d2-e4a40786efea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.302933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a360b32-986a-43fe-b7d2-e4a40786efea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.303034] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a360b32-986a-43fe-b7d2-e4a40786efea',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.393473] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9a80f2c7-a87e-4e86-9344-fccfc66172bf None None] Enqueued Resource ID: 39ffae78-5be0-4271-b16a-57bcd68b6b11 with Priority: HIGHEST for action port [ 572.394671] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ffae78-5be0-4271-b16a-57bcd68b6b11 with Priority: HIGHEST for action port [ 572.395171] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ffae78-5be0-4271-b16a-57bcd68b6b11 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.395593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ffae78-5be0-4271-b16a-57bcd68b6b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.395649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ffae78-5be0-4271-b16a-57bcd68b6b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.397492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ffae78-5be0-4271-b16a-57bcd68b6b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.397492] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ffae78-5be0-4271-b16a-57bcd68b6b11',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.805322] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a360b32-986a-43fe-b7d2-e4a40786efea [ 572.805558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.805747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.805823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.806063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.806151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.806247] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a360b32-986a-43fe-b7d2-e4a40786efea already deleted. [ 572.806327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a360b32-986a-43fe-b7d2-e4a40786efea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.899922] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39ffae78-5be0-4271-b16a-57bcd68b6b11 [ 572.899922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.899922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.899922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.900187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.900224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.900396] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39ffae78-5be0-4271-b16a-57bcd68b6b11 already deleted. [ 572.900396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ffae78-5be0-4271-b16a-57bcd68b6b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.864027] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7da4ae25-4a39-46c8-b89b-f77c09f84978 None None] Enqueued Resource ID: 6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28 with Priority: HIGHEST for action port [ 573.864027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28 with Priority: HIGHEST for action port [ 573.864027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.864027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.864027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.865890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.866027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.074289] env[65738]: INFO networking_nsxv3.common.synchronization [None req-12fee711-a74e-4386-bd44-8e3cef9f90f5 None None] Enqueued Resource ID: 65765a9e-6a83-44e1-bcd7-ca30f072e60a with Priority: HIGHEST for action port [ 574.074289] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65765a9e-6a83-44e1-bcd7-ca30f072e60a with Priority: HIGHEST for action port [ 574.074289] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-65765a9e-6a83-44e1-bcd7-ca30f072e60a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.074511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65765a9e-6a83-44e1-bcd7-ca30f072e60a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.074511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65765a9e-6a83-44e1-bcd7-ca30f072e60a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.074986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65765a9e-6a83-44e1-bcd7-ca30f072e60a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.074986] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65765a9e-6a83-44e1-bcd7-ca30f072e60a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.369611] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28 [ 574.370017] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.370148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.370225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.370461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.370520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.370602] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28 already deleted. [ 574.370684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cc627bf-7d6b-4cf3-aa56-cc7ecaa49b28" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.579764] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65765a9e-6a83-44e1-bcd7-ca30f072e60a [ 574.581038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.581038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.581248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.581288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.581378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.581498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65765a9e-6a83-44e1-bcd7-ca30f072e60a already deleted. [ 574.581580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65765a9e-6a83-44e1-bcd7-ca30f072e60a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.303266] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9b329bdc-e7ef-4f21-a937-33532ef7a1f4 None None] Enqueued Resource ID: 37522985-4c2e-4010-8a66-4995b3a1b7f3 with Priority: HIGHEST for action port [ 575.304650] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37522985-4c2e-4010-8a66-4995b3a1b7f3 with Priority: HIGHEST for action port [ 575.305291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-37522985-4c2e-4010-8a66-4995b3a1b7f3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.305479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37522985-4c2e-4010-8a66-4995b3a1b7f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.305631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37522985-4c2e-4010-8a66-4995b3a1b7f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.305911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37522985-4c2e-4010-8a66-4995b3a1b7f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.306219] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37522985-4c2e-4010-8a66-4995b3a1b7f3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.808612] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37522985-4c2e-4010-8a66-4995b3a1b7f3 [ 575.809532] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.809532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.809532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.809532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.809532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.809532] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37522985-4c2e-4010-8a66-4995b3a1b7f3 already deleted. [ 575.809961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37522985-4c2e-4010-8a66-4995b3a1b7f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.051867] env[65738]: INFO networking_nsxv3.common.synchronization [None req-f7e01351-4593-4df9-8966-57e665d7e26d None None] Enqueued Resource ID: e325236f-4a28-4217-b920-20c9ee75d519 with Priority: HIGHEST for action port [ 577.052663] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e325236f-4a28-4217-b920-20c9ee75d519 with Priority: HIGHEST for action port [ 577.052918] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e325236f-4a28-4217-b920-20c9ee75d519 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.055702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e325236f-4a28-4217-b920-20c9ee75d519" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.056048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e325236f-4a28-4217-b920-20c9ee75d519" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.056711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e325236f-4a28-4217-b920-20c9ee75d519" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.056865] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e325236f-4a28-4217-b920-20c9ee75d519',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.559765] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e325236f-4a28-4217-b920-20c9ee75d519 [ 577.559765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.559969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.560029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.561034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.561034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.561034] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e325236f-4a28-4217-b920-20c9ee75d519 already deleted. [ 577.561034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e325236f-4a28-4217-b920-20c9ee75d519" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.590336] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c1cf73ec-0823-4b0e-bb1b-de5357b76d92 None None] Enqueued Resource ID: f1ba50f4-26b6-43a5-b64e-1549ca93c76f with Priority: HIGHEST for action port [ 577.590938] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ba50f4-26b6-43a5-b64e-1549ca93c76f with Priority: HIGHEST for action port [ 577.591258] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ba50f4-26b6-43a5-b64e-1549ca93c76f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.591391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ba50f4-26b6-43a5-b64e-1549ca93c76f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.591454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ba50f4-26b6-43a5-b64e-1549ca93c76f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.591749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ba50f4-26b6-43a5-b64e-1549ca93c76f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.591831] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ba50f4-26b6-43a5-b64e-1549ca93c76f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.093799] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1ba50f4-26b6-43a5-b64e-1549ca93c76f [ 578.095291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.095291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.095291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.095291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.095291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.095291] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1ba50f4-26b6-43a5-b64e-1549ca93c76f already deleted. [ 578.095291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ba50f4-26b6-43a5-b64e-1549ca93c76f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.984949] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9b01d3da-cd12-4764-ba1f-2adc4e4f848b None None] Enqueued Resource ID: 829eb925-8c6e-4f85-b6ef-cb54af91d7fa with Priority: HIGHEST for action port [ 578.985976] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829eb925-8c6e-4f85-b6ef-cb54af91d7fa with Priority: HIGHEST for action port [ 578.985976] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-829eb925-8c6e-4f85-b6ef-cb54af91d7fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.985976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-829eb925-8c6e-4f85-b6ef-cb54af91d7fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.985976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-829eb925-8c6e-4f85-b6ef-cb54af91d7fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.987437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-829eb925-8c6e-4f85-b6ef-cb54af91d7fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.987650] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('829eb925-8c6e-4f85-b6ef-cb54af91d7fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.076149] env[65738]: INFO networking_nsxv3.common.synchronization [None req-64d1fbf8-6bb4-49ec-a73f-5f888d50ae40 None None] Enqueued Resource ID: 95630c3a-6ada-4fd0-910f-9a78d488803d with Priority: HIGHEST for action port [ 579.076149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95630c3a-6ada-4fd0-910f-9a78d488803d with Priority: HIGHEST for action port [ 579.076149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-95630c3a-6ada-4fd0-910f-9a78d488803d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.076149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95630c3a-6ada-4fd0-910f-9a78d488803d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.076149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95630c3a-6ada-4fd0-910f-9a78d488803d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.076916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95630c3a-6ada-4fd0-910f-9a78d488803d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.077219] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95630c3a-6ada-4fd0-910f-9a78d488803d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.491020] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 829eb925-8c6e-4f85-b6ef-cb54af91d7fa [ 579.491020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.491020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.491020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.491020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.491617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.491617] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:829eb925-8c6e-4f85-b6ef-cb54af91d7fa already deleted. [ 579.491617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-829eb925-8c6e-4f85-b6ef-cb54af91d7fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.580308] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95630c3a-6ada-4fd0-910f-9a78d488803d [ 579.580554] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.580708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.580774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.581091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.581091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.581190] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95630c3a-6ada-4fd0-910f-9a78d488803d already deleted. [ 579.581269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95630c3a-6ada-4fd0-910f-9a78d488803d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.153843] env[65738]: INFO networking_nsxv3.common.synchronization [None req-8f537ae9-a378-4c8e-bfb2-78a623b4baa5 None None] Enqueued Resource ID: 1ad51604-9ba1-4a46-b31b-f5e6af996eeb with Priority: HIGHEST for action port [ 580.155112] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ad51604-9ba1-4a46-b31b-f5e6af996eeb with Priority: HIGHEST for action port [ 580.155112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ad51604-9ba1-4a46-b31b-f5e6af996eeb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.155112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ad51604-9ba1-4a46-b31b-f5e6af996eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.155259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ad51604-9ba1-4a46-b31b-f5e6af996eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.156236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ad51604-9ba1-4a46-b31b-f5e6af996eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.156236] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ad51604-9ba1-4a46-b31b-f5e6af996eeb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.664247] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ad51604-9ba1-4a46-b31b-f5e6af996eeb [ 580.664544] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.664642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.664716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.664919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.665018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.665112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ad51604-9ba1-4a46-b31b-f5e6af996eeb already deleted. [ 580.665188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ad51604-9ba1-4a46-b31b-f5e6af996eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.844051] env[65738]: INFO networking_nsxv3.common.synchronization [None req-44c4a672-a1f4-4338-acb9-a23976fc4b46 None None] Enqueued Resource ID: e723342c-ffd6-4f58-91b8-6672994a78a0 with Priority: HIGHEST for action port [ 580.844876] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e723342c-ffd6-4f58-91b8-6672994a78a0 with Priority: HIGHEST for action port [ 580.844876] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e723342c-ffd6-4f58-91b8-6672994a78a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.845053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e723342c-ffd6-4f58-91b8-6672994a78a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.845265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e723342c-ffd6-4f58-91b8-6672994a78a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.845612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e723342c-ffd6-4f58-91b8-6672994a78a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.845612] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e723342c-ffd6-4f58-91b8-6672994a78a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.349071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e723342c-ffd6-4f58-91b8-6672994a78a0 [ 581.351625] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.351625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.351625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.351864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.351963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.352030] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e723342c-ffd6-4f58-91b8-6672994a78a0 already deleted. [ 581.352113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e723342c-ffd6-4f58-91b8-6672994a78a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.577965] env[65738]: INFO networking_nsxv3.common.synchronization [None req-59387ccf-4685-4f1d-bab4-248c1f05280f None None] Enqueued Resource ID: 5d7155c4-689b-4471-bc7b-bb7ef7b8b807 with Priority: HIGHEST for action port [ 581.578296] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7155c4-689b-4471-bc7b-bb7ef7b8b807 with Priority: HIGHEST for action port [ 581.578647] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d7155c4-689b-4471-bc7b-bb7ef7b8b807 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.578752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d7155c4-689b-4471-bc7b-bb7ef7b8b807" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.578793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d7155c4-689b-4471-bc7b-bb7ef7b8b807" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.580321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d7155c4-689b-4471-bc7b-bb7ef7b8b807" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.580321] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d7155c4-689b-4471-bc7b-bb7ef7b8b807',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.592997] env[65738]: INFO networking_nsxv3.common.synchronization [req-7d3eeab7-e915-4c22-96ea-e7b4ae874fd3 req-243f0bd1-2cd9-48f1-b688-f50a05548375 tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 581.592997] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 581.592997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.592997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.592997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.593720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.593949] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.594143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.594211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.594588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.594741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.594846] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.083252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d7155c4-689b-4471-bc7b-bb7ef7b8b807 [ 582.083252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.083252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.083252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.083252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.083252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.083252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d7155c4-689b-4471-bc7b-bb7ef7b8b807 already deleted. [ 582.083252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d7155c4-689b-4471-bc7b-bb7ef7b8b807" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.100284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.100284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.100284] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd already deleted. [ 582.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.414151] env[65738]: INFO networking_nsxv3.common.synchronization [req-1d28e15d-e3ad-47d9-8934-48e5a5b81db1 req-5b8ae39e-554c-4bf2-bab9-003b130246c6 tempest-DeleteServersAdminTestJSON-2077497370 tempest-DeleteServersAdminTestJSON-2077497370-project-member] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 582.414151] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 582.414151] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.414151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.414151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.414151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.414151] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.416038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.416249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.416518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.416708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.416898] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.514252] env[65738]: INFO networking_nsxv3.common.synchronization [None req-766a8896-daa1-4073-845e-0535c23b3f2b None None] Enqueued Resource ID: b89058a7-b7fe-46f8-8246-9e4da162c8de with Priority: HIGHEST for action port [ 582.514252] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89058a7-b7fe-46f8-8246-9e4da162c8de with Priority: HIGHEST for action port [ 582.514252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89058a7-b7fe-46f8-8246-9e4da162c8de taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.514252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89058a7-b7fe-46f8-8246-9e4da162c8de" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.514252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89058a7-b7fe-46f8-8246-9e4da162c8de" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.514252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89058a7-b7fe-46f8-8246-9e4da162c8de" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.514252] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89058a7-b7fe-46f8-8246-9e4da162c8de',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.674371] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.674612] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.675265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.675265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.675557] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.676190] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.676190] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.676431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.677042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.678124] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.678124] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.678124] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.678124] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.678327] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.678327] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.678382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.701360] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.701492] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 582.701672] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.702635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.702635] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.702635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.702635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.702865] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.703022] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47faf8f8-6dfe-419b-9f34-5c809f3d3c31',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.919344] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.919505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.919587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.919798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.919896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.920100] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.920213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.920320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.920407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.920480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.920563] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c already deleted. [ 582.920642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.007754] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c294bcc7-4fca-4f79-b704-1b7642cc82b1 None None] Enqueued Resource ID: b393f29c-5c7b-4527-a198-69fb1fa54834 with Priority: HIGHEST for action port [ 583.008260] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b393f29c-5c7b-4527-a198-69fb1fa54834 with Priority: HIGHEST for action port [ 583.008550] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b393f29c-5c7b-4527-a198-69fb1fa54834 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.008850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b393f29c-5c7b-4527-a198-69fb1fa54834" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.008850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b393f29c-5c7b-4527-a198-69fb1fa54834" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.008959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b393f29c-5c7b-4527-a198-69fb1fa54834" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.009252] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b393f29c-5c7b-4527-a198-69fb1fa54834',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.016344] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b89058a7-b7fe-46f8-8246-9e4da162c8de [ 583.017020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.017020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.017020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.017020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.017020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.017269] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b89058a7-b7fe-46f8-8246-9e4da162c8de already deleted. [ 583.017269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89058a7-b7fe-46f8-8246-9e4da162c8de" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.163219] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.163543] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.163677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.164427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.164427] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.164565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.164692] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.164898] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.165089] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.165317] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.165506] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.165563] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.165652] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.165765] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.165868] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.165996] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.187256] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.187806] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.187806] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.187910] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.188363] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-89188b8e-96a6-4197-9c23-fdcf33b432d3 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.188631] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.188832] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.189270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.189444] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89188b8e-96a6-4197-9c23-fdcf33b432d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.207697] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.207889] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.207889] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.208148] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.208299] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.208448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 not found, creating... [ 583.208707] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.208857] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.208968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.209197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.209325] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.209681] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.209857] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.209966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.210258] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.210401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.210534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 is going to be created. [ 583.234558] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.234831] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.234875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.235159] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.235375] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.235587] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.511577] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b393f29c-5c7b-4527-a198-69fb1fa54834 [ 583.511842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.511982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.512059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.512275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.512354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.512463] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b393f29c-5c7b-4527-a198-69fb1fa54834 already deleted. [ 583.512550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b393f29c-5c7b-4527-a198-69fb1fa54834" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.692273] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.692542] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.692679] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.692936] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.693091] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.693242] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 89188b8e-96a6-4197-9c23-fdcf33b432d3 not found, creating... [ 583.693503] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.693656] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.693795] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.693975] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.694117] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.694388] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.694537] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.694649] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.694841] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.694963] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.695103] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 89188b8e-96a6-4197-9c23-fdcf33b432d3 is going to be created. [ 583.715478] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.715926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.715926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.716307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.716307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.716497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.951876] env[65738]: INFO networking_nsxv3.common.synchronization [None req-2f6abe24-71dd-4c64-8aff-673884d2b299 None None] Enqueued Resource ID: 4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6 with Priority: HIGHEST for action port [ 583.953193] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6 with Priority: HIGHEST for action port [ 583.953193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.953193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.953193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.953193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.953452] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.023286] env[65738]: INFO networking_nsxv3.common.synchronization [req-7d3eeab7-e915-4c22-96ea-e7b4ae874fd3 req-f8c805e2-1de2-4869-87c7-30aa5843cca4 service nova] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_rules [ 584.023412] env[65738]: INFO networking_nsxv3.common.synchronization [req-7d3eeab7-e915-4c22-96ea-e7b4ae874fd3 req-f8c805e2-1de2-4869-87c7-30aa5843cca4 service nova] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 584.023583] env[65738]: INFO networking_nsxv3.common.synchronization [req-7d3eeab7-e915-4c22-96ea-e7b4ae874fd3 req-f8c805e2-1de2-4869-87c7-30aa5843cca4 service nova] Enqueued Resource ID: 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 with Priority: HIGHEST for action port [ 584.024149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_rules [ 584.024149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 584.024149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 with Priority: HIGHEST for action port [ 584.025263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.028840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.028956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.029272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.029367] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.030309] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.030434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.031453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.031453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.031453] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.033299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.033451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.033545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.033745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.034925] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47faf8f8-6dfe-419b-9f34-5c809f3d3c31',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.458593] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6 [ 584.458880] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.458961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.459025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.459245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.459335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.459536] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6 already deleted. [ 584.459536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a5efa85-b981-4f5b-b4a0-dcea9ab83ca6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.536733] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.536934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.548389] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.550073] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 with status ACTIVE [ 584.550073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.550073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.550073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.550073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.550335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.550335] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.550454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.550496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.550802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.550802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.550956] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.551116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.551175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.551325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.551403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.551557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47faf8f8-6dfe-419b-9f34-5c809f3d3c31 is going to be updated. [ 584.578063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.578765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.578765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.578936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.578936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.579109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47faf8f8-6dfe-419b-9f34-5c809f3d3c31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.627392] env[65738]: INFO networking_nsxv3.common.synchronization [req-1d28e15d-e3ad-47d9-8934-48e5a5b81db1 req-c8586a8b-5600-4f1f-8ca8-adf341e44db3 service nova] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_rules [ 584.627769] env[65738]: INFO networking_nsxv3.common.synchronization [req-1d28e15d-e3ad-47d9-8934-48e5a5b81db1 req-c8586a8b-5600-4f1f-8ca8-adf341e44db3 service nova] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 584.629198] env[65738]: INFO networking_nsxv3.common.synchronization [req-1d28e15d-e3ad-47d9-8934-48e5a5b81db1 req-c8586a8b-5600-4f1f-8ca8-adf341e44db3 service nova] Enqueued Resource ID: 89188b8e-96a6-4197-9c23-fdcf33b432d3 with Priority: HIGHEST for action port [ 584.629388] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_rules [ 584.630100] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 584.630355] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89188b8e-96a6-4197-9c23-fdcf33b432d3 with Priority: HIGHEST for action port [ 584.630739] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.630993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.634018] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.634018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.634018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.634018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.634018] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.635144] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-89188b8e-96a6-4197-9c23-fdcf33b432d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.635266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.635350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.635481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.636523] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89188b8e-96a6-4197-9c23-fdcf33b432d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.054422] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.138068] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.138068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.138068] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.138864] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89188b8e-96a6-4197-9c23-fdcf33b432d3 with status ACTIVE [ 585.139076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.139186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.139242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.139445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.139863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.139863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.139863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.139863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.140143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.140143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.140229] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.141028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.141028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.141028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.141028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.141028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89188b8e-96a6-4197-9c23-fdcf33b432d3 is going to be updated. [ 585.171306] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.171306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.171814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.171814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.171814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.171912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89188b8e-96a6-4197-9c23-fdcf33b432d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.446179] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7236cfe3-5a64-4b02-95bc-7daa740bd654 None None] Enqueued Resource ID: b59a30c9-31a3-4766-8f70-3fab825fa52e with Priority: HIGHEST for action port [ 585.446367] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59a30c9-31a3-4766-8f70-3fab825fa52e with Priority: HIGHEST for action port [ 585.448515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b59a30c9-31a3-4766-8f70-3fab825fa52e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.448646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b59a30c9-31a3-4766-8f70-3fab825fa52e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.448699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b59a30c9-31a3-4766-8f70-3fab825fa52e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.449231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b59a30c9-31a3-4766-8f70-3fab825fa52e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.450932] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b59a30c9-31a3-4766-8f70-3fab825fa52e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.558018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.558561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.558561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.558561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.558737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.558803] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be created. [ 585.592027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.592238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.592335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.592662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.592772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.605976] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: UNINITIALIZED for 2s [ 585.647292] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.953378] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b59a30c9-31a3-4766-8f70-3fab825fa52e [ 585.954574] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.954574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.954574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.954574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.954574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.954574] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b59a30c9-31a3-4766-8f70-3fab825fa52e already deleted. [ 585.954574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b59a30c9-31a3-4766-8f70-3fab825fa52e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.143411] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9b724fea-db6d-4be9-8cab-6a806ced056f tempest-VolumesAssistedSnapshotsTest-42197642 tempest-VolumesAssistedSnapshotsTest-42197642-project-member] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 586.144433] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 586.144812] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.144812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.144812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.145287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.145287] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.151315] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.151496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.151560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.151765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.151853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.151941] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be created. [ 586.180630] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.180777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.180850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.181082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.181244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.193793] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: UNINITIALIZED for 2s [ 586.328980] env[65738]: INFO networking_nsxv3.common.synchronization [None req-56f0d490-d221-4392-9543-586820987a2c tempest-VolumesAssistedSnapshotsTest-42197642 tempest-VolumesAssistedSnapshotsTest-42197642-project-member] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 586.330027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 586.331212] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.331371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.593168] env[65738]: INFO networking_nsxv3.common.synchronization [None req-33fb1dc5-9bff-4fce-8b4f-f703c60b3573 None None] Enqueued Resource ID: 394963ef-c90e-4bf5-896c-3cd775dcfa63 with Priority: HIGHEST for action port [ 586.593945] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394963ef-c90e-4bf5-896c-3cd775dcfa63 with Priority: HIGHEST for action port [ 586.594313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-394963ef-c90e-4bf5-896c-3cd775dcfa63 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.594477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-394963ef-c90e-4bf5-896c-3cd775dcfa63" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.594533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-394963ef-c90e-4bf5-896c-3cd775dcfa63" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.594805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-394963ef-c90e-4bf5-896c-3cd775dcfa63" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.594885] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394963ef-c90e-4bf5-896c-3cd775dcfa63',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.673028] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.673028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd already deleted. [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.673028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.673028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.786912] env[65738]: INFO networking_nsxv3.common.synchronization [req-7cc6ffb8-8644-45a4-878f-0055a735a87f req-65525dba-b0e1-4fc3-b77a-6a34953b1c6a tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 586.786912] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 586.786912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.786912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.786912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.786912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.787260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.787260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.787260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.787794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.787894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.788045] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.098599] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 394963ef-c90e-4bf5-896c-3cd775dcfa63 [ 587.098700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.098925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.098978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.099259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.099394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.099537] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:394963ef-c90e-4bf5-896c-3cd775dcfa63 already deleted. [ 587.099671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-394963ef-c90e-4bf5-896c-3cd775dcfa63" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.197096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.197241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.197296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.197481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.197569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.197662] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd already deleted. [ 587.197755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.226752] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.227010] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.227164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.227578] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.227863] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.228842] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.229073] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.229349] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.229499] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.229771] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.229896] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.230038] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.230147] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.230256] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.230377] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.230482] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.253746] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.253944] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.254335] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.254447] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.254843] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-2582a89e-32c4-4cf5-9808-2ea2340a0f69 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.255285] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.255445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.255908] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.256150] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2582a89e-32c4-4cf5-9808-2ea2340a0f69',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.292069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.292069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.292404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.292404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.292550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.292719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.292856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.292896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.293091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.293251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.293251] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 already deleted. [ 587.293334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.500415] env[65738]: INFO networking_nsxv3.common.synchronization [req-8f940615-bbcc-456c-9e53-5e4b8c403def req-182b57d1-3965-4bb3-bc77-cb17d13c4522 tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: 6386b41e-5749-4213-8207-2b7c1eabd07c with Priority: HIGHEST for action security_group_rules [ 587.500683] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6386b41e-5749-4213-8207-2b7c1eabd07c with Priority: HIGHEST for action security_group_rules [ 587.502119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6386b41e-5749-4213-8207-2b7c1eabd07c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.502263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6386b41e-5749-4213-8207-2b7c1eabd07c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.502349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6386b41e-5749-4213-8207-2b7c1eabd07c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.502587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6386b41e-5749-4213-8207-2b7c1eabd07c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.502681] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6386b41e-5749-4213-8207-2b7c1eabd07c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.618557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 587.618832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.619012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.619273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.619523] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.619751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.619751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.619981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.620104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.620226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.620371] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.758283] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.758509] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.758653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.758887] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.759030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.759180] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 2582a89e-32c4-4cf5-9808-2ea2340a0f69 not found, creating... [ 587.759501] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.759701] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.759774] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.760019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.760156] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.760548] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.760621] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.762186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.762186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.762186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.762186] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 2582a89e-32c4-4cf5-9808-2ea2340a0f69 is going to be created. [ 587.829991] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.830275] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.830275] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.830463] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.830757] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.831011] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.042337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.042337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.042337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.042337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.042337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.042337] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6386b41e-5749-4213-8207-2b7c1eabd07c already deleted. [ 588.042337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6386b41e-5749-4213-8207-2b7c1eabd07c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.125312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.125312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.125312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.125312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.125312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.126532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.126532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.126532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.126532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.126532] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.205652] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 588.205874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.206075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.206343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.206549] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.206754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.206754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.206956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.207080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.207191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.207379] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.370148] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c08067b9-9ee6-4afb-89b7-ef74e955fbc8 None None] Enqueued Resource ID: 7d24e367-0c07-4e83-a305-f303514d477d with Priority: HIGHEST for action port [ 588.370148] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d24e367-0c07-4e83-a305-f303514d477d with Priority: HIGHEST for action port [ 588.370148] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d24e367-0c07-4e83-a305-f303514d477d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.370148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d24e367-0c07-4e83-a305-f303514d477d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.370148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d24e367-0c07-4e83-a305-f303514d477d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.371048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d24e367-0c07-4e83-a305-f303514d477d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.371298] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d24e367-0c07-4e83-a305-f303514d477d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.518736] env[65738]: INFO networking_nsxv3.common.synchronization [req-7cc6ffb8-8644-45a4-878f-0055a735a87f req-a6ac0fbc-acad-4dfa-874b-27d8f2cef4bc service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 588.518948] env[65738]: INFO networking_nsxv3.common.synchronization [req-7cc6ffb8-8644-45a4-878f-0055a735a87f req-a6ac0fbc-acad-4dfa-874b-27d8f2cef4bc service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 588.519080] env[65738]: INFO networking_nsxv3.common.synchronization [req-7cc6ffb8-8644-45a4-878f-0055a735a87f req-a6ac0fbc-acad-4dfa-874b-27d8f2cef4bc service nova] Enqueued Resource ID: 2582a89e-32c4-4cf5-9808-2ea2340a0f69 with Priority: HIGHEST for action port [ 588.519772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 588.519863] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 588.519996] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2582a89e-32c4-4cf5-9808-2ea2340a0f69 with Priority: HIGHEST for action port [ 588.520525] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.520699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.520745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.521566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.521566] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.525734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.525869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.525932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.527194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.527194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.527194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.527194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.527194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.527194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.527194] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.530642] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2582a89e-32c4-4cf5-9808-2ea2340a0f69 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.530765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.531105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.531105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.531105] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2582a89e-32c4-4cf5-9808-2ea2340a0f69',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.628487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e974415d-6bf2-41ac-b8e6-2817575b8abd: rpc.has_security_group_logging(os_id): False [ 588.647634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.647634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.647634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.647634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.647634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.647634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.647634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.648020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.648020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.648020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.648110] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.648164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.648224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.648684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.648684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.648684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.648684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.648861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.648861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.648929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.649027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be created. [ 588.709533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.709782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.709782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.710107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.710303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.710420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.710486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.710646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.710734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.710819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.710957] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.711062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.711145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.711300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.711486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.711580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.711631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.711775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.711851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.711931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.714122] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.719762] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.719762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.719762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.719762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.719762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.734503] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 588.874344] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d24e367-0c07-4e83-a305-f303514d477d [ 588.874598] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.874738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.874807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.875034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.875125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.875219] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d24e367-0c07-4e83-a305-f303514d477d already deleted. [ 588.875295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d24e367-0c07-4e83-a305-f303514d477d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.034918] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.034918] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.034918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.036805] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2582a89e-32c4-4cf5-9808-2ea2340a0f69 with status ACTIVE [ 589.040341] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.040341] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.040341] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.040341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.040341] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2582a89e-32c4-4cf5-9808-2ea2340a0f69 is going to be updated. [ 589.064591] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.064591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.064758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.064827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.064958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.065128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2582a89e-32c4-4cf5-9808-2ea2340a0f69" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.212435] env[65738]: INFO networking_nsxv3.common.synchronization [req-8735ec11-fcdd-4ba6-9c73-970d40860e54 req-17e13113-9267-4679-b2c3-f63e874a63c7 tempest-FloatingIPsAssociationNegativeTestJSON-1659273675 tempest-FloatingIPsAssociationNegativeTestJSON-1659273675-project-member] Enqueued Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 589.215997] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 589.215997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.215997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.215997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.215997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.216271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.216349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.216491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.217878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.217924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.217990] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.219162] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 907c22c5-ad71-4896-a4e9-e9855577ba3c: rpc.has_security_group_logging(os_id): False [ 589.251094] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.251322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.251531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.251812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.251913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.252121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.252221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.252491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.252665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.252742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.252936] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.253058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.253130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.253290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.253375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.253586] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.253764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.253835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.253998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.254464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.254559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be created. [ 589.322919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.323074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.323145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.323359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.323534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.337193] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 589.537484] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.594606] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5eae0346-491c-490c-b12f-aba2b1f087df None None] Enqueued Resource ID: 0eb54492-7beb-4662-9854-3d8bdab6cdae with Priority: HIGHEST for action port [ 589.594872] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eb54492-7beb-4662-9854-3d8bdab6cdae with Priority: HIGHEST for action port [ 589.595463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eb54492-7beb-4662-9854-3d8bdab6cdae taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.595593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eb54492-7beb-4662-9854-3d8bdab6cdae" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.595665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eb54492-7beb-4662-9854-3d8bdab6cdae" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.595921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eb54492-7beb-4662-9854-3d8bdab6cdae" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.596011] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb54492-7beb-4662-9854-3d8bdab6cdae',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.644478] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.644478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-118" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.644478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-118" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.644478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-118" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.644977] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.644977] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.645383] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.645864] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.645864] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.646573] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.646573] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.646573] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.646573] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.646573] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.646573] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.646806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.669868] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.669868] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.669868] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.669868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-118" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.669868] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b5022196-15a0-4960-a894-0bae6104ae6d taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.669868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.669868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.669868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.669868] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5022196-15a0-4960-a894-0bae6104ae6d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.721020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.721782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.721782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.722080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.722248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.722562] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.722732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.723160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.723160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.723160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.723160] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf78d499-f745-40ce-9541-deee900c2003 already deleted. [ 589.723397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.041414] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.041687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.041725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.042259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.042259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.042259] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be created. [ 590.070359] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.070359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.070359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.070687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.070687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.082062] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: UNINITIALIZED for 2s [ 590.098547] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eb54492-7beb-4662-9854-3d8bdab6cdae [ 590.098784] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.098921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.098986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.099227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.099309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.099413] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eb54492-7beb-4662-9854-3d8bdab6cdae already deleted. [ 590.099505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eb54492-7beb-4662-9854-3d8bdab6cdae" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.176043] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.176043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b5022196-15a0-4960-a894-0bae6104ae6d not found, creating... [ 590.176043] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.176043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.176516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.176516] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.176618] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.176649] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.178028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.178028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.178028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b5022196-15a0-4960-a894-0bae6104ae6d is going to be created. [ 590.201125] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.204263] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.204478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.205213] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.205213] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.206174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.749340] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 590.749340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.769019] env[65738]: INFO networking_nsxv3.common.synchronization [req-ccb99acd-8c25-406e-8252-902d95df4c6b req-e583086e-1e29-4d83-a02d-0097add89fbd tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: f5845e4e-1ed0-4b65-9ace-88101550fe7a with Priority: HIGHEST for action security_group_rules [ 590.769019] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5845e4e-1ed0-4b65-9ace-88101550fe7a with Priority: HIGHEST for action security_group_rules [ 590.769172] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5845e4e-1ed0-4b65-9ace-88101550fe7a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.769172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5845e4e-1ed0-4b65-9ace-88101550fe7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.769305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5845e4e-1ed0-4b65-9ace-88101550fe7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.769576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5845e4e-1ed0-4b65-9ace-88101550fe7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.769749] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5845e4e-1ed0-4b65-9ace-88101550fe7a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [req-8735ec11-fcdd-4ba6-9c73-970d40860e54 req-058ec1ef-bf6b-48ed-8dd4-a083bf686066 service nova] Enqueued Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_rules [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [req-8735ec11-fcdd-4ba6-9c73-970d40860e54 req-058ec1ef-bf6b-48ed-8dd4-a083bf686066 service nova] Enqueued Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [req-8735ec11-fcdd-4ba6-9c73-970d40860e54 req-058ec1ef-bf6b-48ed-8dd4-a083bf686066 service nova] Enqueued Resource ID: b5022196-15a0-4960-a894-0bae6104ae6d with Priority: HIGHEST for action port [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_rules [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 590.936346] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5022196-15a0-4960-a894-0bae6104ae6d with Priority: HIGHEST for action port [ 590.936346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.936346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.936346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.936346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.937058] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.938248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.938483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.938702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.938956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.939827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.940442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.940442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.940442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.940442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.940621] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.942102] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5022196-15a0-4960-a894-0bae6104ae6d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.942102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.942102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.942279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.942279] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5022196-15a0-4960-a894-0bae6104ae6d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.293242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.293379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.293448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.293664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.293746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.293836] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5845e4e-1ed0-4b65-9ace-88101550fe7a already deleted. [ 591.293961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5845e4e-1ed0-4b65-9ace-88101550fe7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.358603] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 591.358834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.446351] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.448021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.448233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.448507] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5022196-15a0-4960-a894-0bae6104ae6d with status ACTIVE [ 591.449297] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.449585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.449686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.449901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.449994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.450355] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.450355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.450451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.450563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.450641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.450835] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.450930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.451061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.451151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.451232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.451318] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5022196-15a0-4960-a894-0bae6104ae6d is going to be updated. [ 591.497409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.497580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.497687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.498166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.498380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.498601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5022196-15a0-4960-a894-0bae6104ae6d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.955748] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.100076] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 592.100076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.100273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.100497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.100710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.100828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.100879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.101055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.101679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.101679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.101679] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.459665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.459867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.459953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.460194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.460283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.460385] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf78d499-f745-40ce-9541-deee900c2003 is going to be created. [ 592.488096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.488294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.488340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.488567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.488732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.501382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: UNINITIALIZED for 2s [ 592.604223] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.604489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.604633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.605637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.605880] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.606008] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.606107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.606333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.606455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.606589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.606799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.606919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.606983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.607188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.607404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.607547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.607643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.609662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.609662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.609662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.609662] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.111110] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1: rpc.has_security_group_logging(os_id): False [ 593.132114] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.132285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.132357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.132567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.132668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.132882] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.132995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.133079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.134787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.134971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.135235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.135341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.135433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.135595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.135707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.135891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.135954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.136638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.136638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.136638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.136638] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be created. [ 593.208801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.211035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.211035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.211035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.211035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.225737] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 594.175206] env[65738]: INFO networking_nsxv3.common.synchronization [req-b880f7f1-fa90-4e6b-9f03-5908a934723f req-7779a665-fe2b-493f-b7cc-fe888dba645d tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: bcece19f-ecb4-4ee0-b78b-c3c6a91910c7 with Priority: HIGHEST for action security_group_rules [ 594.176484] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcece19f-ecb4-4ee0-b78b-c3c6a91910c7 with Priority: HIGHEST for action security_group_rules [ 594.177128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcece19f-ecb4-4ee0-b78b-c3c6a91910c7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.177262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcece19f-ecb4-4ee0-b78b-c3c6a91910c7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.177327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcece19f-ecb4-4ee0-b78b-c3c6a91910c7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.177589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcece19f-ecb4-4ee0-b78b-c3c6a91910c7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.177666] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcece19f-ecb4-4ee0-b78b-c3c6a91910c7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.513842] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: SUCCESS [ 594.514087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.514260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.514504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.514725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.514847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.514986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.515100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.515187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.515321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.515379] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.702775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.702922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.702993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.703490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.703623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.703727] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcece19f-ecb4-4ee0-b78b-c3c6a91910c7 already deleted. [ 594.704111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcece19f-ecb4-4ee0-b78b-c3c6a91910c7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.018075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.018238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.018307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.018528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.018695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.018791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.018849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.018991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.019093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.019184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.019396] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.019497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.019555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.019696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.019832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.019917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.019973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.020118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.020190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.020267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.020360] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.240154] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 595.240417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.524189] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf78d499-f745-40ce-9541-deee900c2003: rpc.has_security_group_logging(os_id): False [ 595.546121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.546345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.546429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.546685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.548633] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.548633] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.548633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.549255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.549527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.549732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.550460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.550544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.550687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf78d499-f745-40ce-9541-deee900c2003 is going to be created. [ 595.649758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.649940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.649986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.650208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.650388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.663304] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: IN_PROGRESS for 2s [ 595.814327] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a5f09310-0f87-43a9-8237-1d9de2e4e3e6 tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 595.814327] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 595.814428] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.814593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.814696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.814999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.815140] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.964851] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0e5a474b-84c4-4045-b3a5-d09ee7800708 tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 595.964851] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 595.964851] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.964851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.259055] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a256626e-bf92-462c-9e7e-2f4b6955b131 None None] Enqueued Resource ID: 9f5481e5-2c67-45c0-9c06-afebca1a6f52 with Priority: HIGHEST for action port [ 596.259055] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5481e5-2c67-45c0-9c06-afebca1a6f52 with Priority: HIGHEST for action port [ 596.259504] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f5481e5-2c67-45c0-9c06-afebca1a6f52 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.259504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f5481e5-2c67-45c0-9c06-afebca1a6f52" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.259698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f5481e5-2c67-45c0-9c06-afebca1a6f52" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.259889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f5481e5-2c67-45c0-9c06-afebca1a6f52" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.259980] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5481e5-2c67-45c0-9c06-afebca1a6f52',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.348454] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.349011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.349011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.349751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.349865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.349964] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 already deleted. [ 596.350062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.350289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.350458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.350458] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.763430] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f5481e5-2c67-45c0-9c06-afebca1a6f52 [ 596.765516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.765516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.765516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.765516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.765516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.765516] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f5481e5-2c67-45c0-9c06-afebca1a6f52 already deleted. [ 596.765516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f5481e5-2c67-45c0-9c06-afebca1a6f52" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.877993] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.878213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.878213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.878527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.878626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.878733] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 already deleted. [ 596.878834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.254886] env[65738]: INFO networking_nsxv3.common.synchronization [req-55d7f352-4b30-428d-8ec3-83b127f111c6 req-9d27e584-1229-48f7-b7da-476afe74227f tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 597.255445] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 597.255755] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.255869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.255938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.256201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.257312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.257420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.257792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.257792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.257792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.257907] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.679760] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: SUCCESS [ 597.680089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.764051] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.764261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.764261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.764486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.764567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.764742] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.764875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.764962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.765051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.765126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.765209] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 already deleted. [ 597.765277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.816838] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.817057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.817238] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.817514] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.817865] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.818045] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.819150] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.819150] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.819150] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.819150] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.819150] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.819150] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.819150] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.819150] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.819471] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.819471] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.867622] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.867893] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.868044] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.868258] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.868526] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-3b977403-e435-4cc6-bf27-c45234d670d2 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.869149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.869149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.869149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.869347] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b977403-e435-4cc6-bf27-c45234d670d2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.372334] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.372841] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.372985] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.373311] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.373459] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.373684] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 3b977403-e435-4cc6-bf27-c45234d670d2 not found, creating... [ 598.373988] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.374177] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.374301] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.374528] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.374661] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.374948] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.375745] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.375894] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.376170] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.376366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.376626] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 3b977403-e435-4cc6-bf27-c45234d670d2 is going to be created. [ 598.407573] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.407862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.408044] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.408467] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.408703] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.409322] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.704439] env[65738]: INFO networking_nsxv3.common.synchronization [None req-be4caf05-7d05-4d1a-b81b-e16b4ea5d5ac None None] Enqueued Resource ID: c0670517-42bb-4422-ae4b-a89880b47df4 with Priority: HIGHEST for action port [ 598.705136] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0670517-42bb-4422-ae4b-a89880b47df4 with Priority: HIGHEST for action port [ 598.705284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0670517-42bb-4422-ae4b-a89880b47df4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.705460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0670517-42bb-4422-ae4b-a89880b47df4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.706637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0670517-42bb-4422-ae4b-a89880b47df4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.706637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0670517-42bb-4422-ae4b-a89880b47df4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.706637] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0670517-42bb-4422-ae4b-a89880b47df4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.159930] env[65738]: INFO networking_nsxv3.common.synchronization [req-55d7f352-4b30-428d-8ec3-83b127f111c6 req-c9770511-ae56-4dfa-9315-2abce6e87689 service nova] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 599.160705] env[65738]: INFO networking_nsxv3.common.synchronization [req-55d7f352-4b30-428d-8ec3-83b127f111c6 req-c9770511-ae56-4dfa-9315-2abce6e87689 service nova] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 599.160705] env[65738]: INFO networking_nsxv3.common.synchronization [req-55d7f352-4b30-428d-8ec3-83b127f111c6 req-c9770511-ae56-4dfa-9315-2abce6e87689 service nova] Enqueued Resource ID: 3b977403-e435-4cc6-bf27-c45234d670d2 with Priority: HIGHEST for action port [ 599.160782] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 599.160905] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 599.161053] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b977403-e435-4cc6-bf27-c45234d670d2 with Priority: HIGHEST for action port [ 599.161644] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.161771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.161830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.162050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.162132] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.163331] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.163700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.163775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.163954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.164140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.164245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.164305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.164454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.164541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.164650] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.165676] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b977403-e435-4cc6-bf27-c45234d670d2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.165676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.165832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.165864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.165945] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b977403-e435-4cc6-bf27-c45234d670d2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.208846] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0670517-42bb-4422-ae4b-a89880b47df4 [ 599.209436] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.209722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.209876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.210189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.210413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.210795] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0670517-42bb-4422-ae4b-a89880b47df4 already deleted. [ 599.210795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0670517-42bb-4422-ae4b-a89880b47df4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.452033] env[65738]: INFO networking_nsxv3.common.synchronization [None req-533a9476-b8bc-42f9-b6de-b0ba2f3398b0 None None] Enqueued Resource ID: 2c572d71-94e5-4472-9909-7c261d8965c4 with Priority: HIGHEST for action port [ 599.453169] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c572d71-94e5-4472-9909-7c261d8965c4 with Priority: HIGHEST for action port [ 599.453448] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c572d71-94e5-4472-9909-7c261d8965c4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.455035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c572d71-94e5-4472-9909-7c261d8965c4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.455035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c572d71-94e5-4472-9909-7c261d8965c4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.455035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c572d71-94e5-4472-9909-7c261d8965c4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.455035] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c572d71-94e5-4472-9909-7c261d8965c4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.668036] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.668036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.668036] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.668980] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b977403-e435-4cc6-bf27-c45234d670d2 with status ACTIVE [ 599.669629] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.669629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.669629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.669629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.669629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.670475] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.670475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.670475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.670475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.670475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.670475] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.670703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.670703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.670703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.670811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.670915] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b977403-e435-4cc6-bf27-c45234d670d2 is going to be updated. [ 599.694900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.695141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.695276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.695463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.695621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.695829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b977403-e435-4cc6-bf27-c45234d670d2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.791142] env[65738]: INFO networking_nsxv3.common.synchronization [req-e20f58dd-2c5a-4c9a-b9c5-c26d84be9662 req-4cd0b0f4-04a8-4eb7-bdd5-d374176c8562 tempest-ServerDiagnosticsNegativeTest-151714200 tempest-ServerDiagnosticsNegativeTest-151714200-project-member] Enqueued Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 599.791777] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 599.792687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.792880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.793021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.793245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.793425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.794028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.794156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.794364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.794485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.794832] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.959944] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c572d71-94e5-4472-9909-7c261d8965c4 [ 599.960217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.960355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.960427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.960637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.960752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.960857] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c572d71-94e5-4472-9909-7c261d8965c4 already deleted. [ 599.960940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c572d71-94e5-4472-9909-7c261d8965c4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.172747] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.280431] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.281846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.281846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.282862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.283594] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.283703] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.283900] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.284180] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.284329] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.284536] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.284641] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.284739] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.285543] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.285543] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.285543] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.285543] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.297173] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.297357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.297439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.297660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.297750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.298203] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.298203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.298203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.298459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.298459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.298459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b already deleted. [ 600.298554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.305854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.306046] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.306179] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.306321] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.306659] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-bc093131-f67b-449c-9958-0fbe222331f6 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.306921] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.307048] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.307374] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.307602] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc093131-f67b-449c-9958-0fbe222331f6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.676892] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.676892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.676892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.676892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.676892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.676892] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be created. [ 600.708824] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.709045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.709114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.709412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.709618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.721217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: UNINITIALIZED for 2s [ 600.810478] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.810806] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.810948] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.811347] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.811546] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.811777] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port bc093131-f67b-449c-9958-0fbe222331f6 not found, creating... [ 600.812411] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.812411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.812561] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.812797] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.812961] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.813449] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.813776] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.813926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.814138] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.814327] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.814505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: bc093131-f67b-449c-9958-0fbe222331f6 is going to be created. [ 600.835396] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.835664] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.835711] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.836083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.836226] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.836459] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.590907] env[65738]: INFO networking_nsxv3.common.synchronization [req-e20f58dd-2c5a-4c9a-b9c5-c26d84be9662 req-43ad0104-d531-4ec8-a63c-28a58f9ed8a4 service nova] Enqueued Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_rules [ 601.591343] env[65738]: INFO networking_nsxv3.common.synchronization [req-e20f58dd-2c5a-4c9a-b9c5-c26d84be9662 req-43ad0104-d531-4ec8-a63c-28a58f9ed8a4 service nova] Enqueued Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 601.591566] env[65738]: INFO networking_nsxv3.common.synchronization [req-e20f58dd-2c5a-4c9a-b9c5-c26d84be9662 req-43ad0104-d531-4ec8-a63c-28a58f9ed8a4 service nova] Enqueued Resource ID: bc093131-f67b-449c-9958-0fbe222331f6 with Priority: HIGHEST for action port [ 601.592376] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_rules [ 601.592575] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 601.592682] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc093131-f67b-449c-9958-0fbe222331f6 with Priority: HIGHEST for action port [ 601.593062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.593247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.593340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.593868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.593955] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.594960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.595293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.595592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.595592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.595776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.595905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.595968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.596125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.596396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.596599] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.598533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc093131-f67b-449c-9958-0fbe222331f6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.598533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.598533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.598533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.598897] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc093131-f67b-449c-9958-0fbe222331f6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.695696] env[65738]: INFO networking_nsxv3.common.synchronization [None req-261206e1-38b3-45fd-940f-4ced232b94e3 None None] Enqueued Resource ID: cb3be97a-469d-455b-a814-d63245b66769 with Priority: HIGHEST for action port [ 601.696149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb3be97a-469d-455b-a814-d63245b66769 with Priority: HIGHEST for action port [ 601.697440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb3be97a-469d-455b-a814-d63245b66769 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.697440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb3be97a-469d-455b-a814-d63245b66769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.697440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb3be97a-469d-455b-a814-d63245b66769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.697440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb3be97a-469d-455b-a814-d63245b66769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.697440] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb3be97a-469d-455b-a814-d63245b66769',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.942854] env[65738]: INFO networking_nsxv3.common.synchronization [req-7f0f60d6-cafe-4ff5-9126-55de545bff99 req-f694dc55-df32-46ff-b678-9416df070f79 tempest-ServerExternalEventsTest-267735185 tempest-ServerExternalEventsTest-267735185-project-member] Enqueued Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 601.942854] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 601.942854] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.942854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.942854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.943349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.943349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.943349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.943567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.943567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.943678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.943755] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.101056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.101221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.101425] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.103935] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc093131-f67b-449c-9958-0fbe222331f6 with status ACTIVE [ 602.104228] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.104371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.104442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.104660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.104747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.104932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.105046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.105102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.105251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.105323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.105514] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.105685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.105685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.105825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.105881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.106027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc093131-f67b-449c-9958-0fbe222331f6 is going to be updated. [ 602.133282] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.133550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.133618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.133912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.134100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.134353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc093131-f67b-449c-9958-0fbe222331f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.202577] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb3be97a-469d-455b-a814-d63245b66769 [ 602.202882] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.203056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.203142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.203416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.203613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.203663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb3be97a-469d-455b-a814-d63245b66769 already deleted. [ 602.203766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb3be97a-469d-455b-a814-d63245b66769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.314112] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314112] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314112] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314112] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.314112] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.315083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.315232] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315454] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.315560] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.315660] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.315758] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.315858] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.315953] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.316096] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.358492] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.358492] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.358492] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.358492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.358492] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-0f6d5ba0-6064-47cf-99d9-3282e48ce548 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.358492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.358765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.362021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.362021] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f6d5ba0-6064-47cf-99d9-3282e48ce548',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.445812] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.445994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.448222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.448539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.448647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.448900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.449018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.449076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.449290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.449410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.449455] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 already deleted. [ 602.449859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.611072] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.736824] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 602.736958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.737148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.737479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.737694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.737789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.737789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.738275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.738275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.738275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.738555] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.864465] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.864773] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.864846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.865285] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.865285] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.865580] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 0f6d5ba0-6064-47cf-99d9-3282e48ce548 not found, creating... [ 602.865858] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.866042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.866160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.866388] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.866526] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.866811] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.866963] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.867084] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.867288] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.867440] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.867601] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 0f6d5ba0-6064-47cf-99d9-3282e48ce548 is going to be created. [ 602.891057] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.891340] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.891652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.892083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.892466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.892833] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.955916] env[65738]: INFO networking_nsxv3.common.synchronization [None req-147ce798-6890-433c-bd48-42b0a56794d7 None None] Enqueued Resource ID: a28ef730-1bd7-4d2e-8cca-d37963dd493a with Priority: HIGHEST for action port [ 602.956499] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28ef730-1bd7-4d2e-8cca-d37963dd493a with Priority: HIGHEST for action port [ 602.956853] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a28ef730-1bd7-4d2e-8cca-d37963dd493a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.957068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a28ef730-1bd7-4d2e-8cca-d37963dd493a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.957068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a28ef730-1bd7-4d2e-8cca-d37963dd493a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.957257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a28ef730-1bd7-4d2e-8cca-d37963dd493a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.957336] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28ef730-1bd7-4d2e-8cca-d37963dd493a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.113705] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.113907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.113960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.114174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.114263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.115181] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b is going to be created. [ 603.140626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.140772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.140879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.141054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.141214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.152389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: UNINITIALIZED for 2s [ 603.241088] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.459880] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a28ef730-1bd7-4d2e-8cca-d37963dd493a [ 603.460242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.460318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.460365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.460639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.460734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.460830] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a28ef730-1bd7-4d2e-8cca-d37963dd493a already deleted. [ 603.460912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a28ef730-1bd7-4d2e-8cca-d37963dd493a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [req-7f0f60d6-cafe-4ff5-9126-55de545bff99 req-bf922700-4ec1-44ee-a239-97954fb55c83 service nova] Enqueued Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_rules [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [req-7f0f60d6-cafe-4ff5-9126-55de545bff99 req-bf922700-4ec1-44ee-a239-97954fb55c83 service nova] Enqueued Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [req-7f0f60d6-cafe-4ff5-9126-55de545bff99 req-bf922700-4ec1-44ee-a239-97954fb55c83 service nova] Enqueued Resource ID: 0f6d5ba0-6064-47cf-99d9-3282e48ce548 with Priority: HIGHEST for action port [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_rules [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 603.681133] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6d5ba0-6064-47cf-99d9-3282e48ce548 with Priority: HIGHEST for action port [ 603.681133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.681633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.681633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.681938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.682039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.683326] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.684755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.684755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.684755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.685073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.685073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.685073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.685303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.685303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.687315] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.688450] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f6d5ba0-6064-47cf-99d9-3282e48ce548 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.688612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.689295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.689295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.689295] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f6d5ba0-6064-47cf-99d9-3282e48ce548',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.743318] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13e04b13-1f3c-4f36-a68f-be19736a3742: rpc.has_security_group_logging(os_id): False [ 603.764243] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.766117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.766117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.766117] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be created. [ 603.833033] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.833033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.833033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.833033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.833033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.844288] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 604.020043] env[65738]: INFO networking_nsxv3.common.synchronization [req-a11aed8d-6a1b-42e5-a35f-791898ac2d8d req-94d827ee-4e67-4b6a-9354-25d971ba6448 tempest-VolumesAdminNegativeTest-1402103223 tempest-VolumesAdminNegativeTest-1402103223-project-member] Enqueued Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 604.020043] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 604.020043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.020043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.020043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.020043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.021471] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.021471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.021471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.021471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.021471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.021471] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.193253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.193477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.193602] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.194925] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f6d5ba0-6064-47cf-99d9-3282e48ce548 with status ACTIVE [ 604.194925] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.194925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.194925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.195256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.196270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.196694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.196694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.196694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.196884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.196884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.197788] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.197990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.198091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.198264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.199040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.199040] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f6d5ba0-6064-47cf-99d9-3282e48ce548 is going to be updated. [ 604.231510] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.231510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.231510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.231510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.231686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.231778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f6d5ba0-6064-47cf-99d9-3282e48ce548" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.498401] env[65738]: INFO networking_nsxv3.common.synchronization [req-6c10b5f7-c6ba-4cfd-a197-a1182b85709a req-5a005e25-e810-4f04-b3d5-b345666343ef tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: ae3adadf-a5cf-4ddb-9f32-20013551d78b with Priority: HIGHEST for action security_group_rules [ 604.498939] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3adadf-a5cf-4ddb-9f32-20013551d78b with Priority: HIGHEST for action security_group_rules [ 604.499256] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae3adadf-a5cf-4ddb-9f32-20013551d78b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.499392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae3adadf-a5cf-4ddb-9f32-20013551d78b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.499466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae3adadf-a5cf-4ddb-9f32-20013551d78b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.499798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae3adadf-a5cf-4ddb-9f32-20013551d78b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.499798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae3adadf-a5cf-4ddb-9f32-20013551d78b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.506492] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.506492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-64" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.506492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-64" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.506492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-64" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.506806] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.507014] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.507134] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.507676] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.508132] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.508380] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.508459] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.508564] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.508666] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.508950] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.508950] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.509041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.525133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.525312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.525375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.525582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.525683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.525869] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.525965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.526082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.526188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.526260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.526344] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 already deleted. [ 604.526432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.534836] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.534836] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.534836] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.534836] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-64" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.534836] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-40478db5-121a-427c-84db-08d463cefc2c taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.534836] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.535401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.535401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.536424] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40478db5-121a-427c-84db-08d463cefc2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.701652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.037946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.038355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.038355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.038645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.038738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.038839] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae3adadf-a5cf-4ddb-9f32-20013551d78b already deleted. [ 605.038926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae3adadf-a5cf-4ddb-9f32-20013551d78b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.039493] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.039784] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.039965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.040435] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.040632] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.041017] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 40478db5-121a-427c-84db-08d463cefc2c not found, creating... [ 605.041388] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.041589] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.041734] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.042037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.042292] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.042613] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.043127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.043127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.043234] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.044366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.044366] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 40478db5-121a-427c-84db-08d463cefc2c is going to be created. [ 605.078180] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.078286] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.078499] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.079083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.079418] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.079542] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.186020] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: SUCCESS [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.186020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.186020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.186020] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.205792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.205792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.205792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.206113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.206113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.206175] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 is going to be created. [ 605.244196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.244402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.244521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.244829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.244985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.261730] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: UNINITIALIZED for 2s [ 605.658843] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9d3c5c99-609a-4130-af10-e8b0ee4f1edd None None] Enqueued Resource ID: b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7 with Priority: HIGHEST for action port [ 605.660131] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7 with Priority: HIGHEST for action port [ 605.660131] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.660131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.660131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.661031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.661031] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.697539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.697762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.697814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.698016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.698239] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.698405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.698484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.698777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.698777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.698777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.699206] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.699206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.699360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.699448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.699660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.699788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.699888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.699951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.700105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.700215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.700290] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.858936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 605.860239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.866551] env[65738]: INFO networking_nsxv3.common.synchronization [req-a11aed8d-6a1b-42e5-a35f-791898ac2d8d req-114a781a-8555-43e4-ab7c-e46655ee9edb service nova] Enqueued Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_rules [ 605.868031] env[65738]: INFO networking_nsxv3.common.synchronization [req-a11aed8d-6a1b-42e5-a35f-791898ac2d8d req-114a781a-8555-43e4-ab7c-e46655ee9edb service nova] Enqueued Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 605.868031] env[65738]: INFO networking_nsxv3.common.synchronization [req-a11aed8d-6a1b-42e5-a35f-791898ac2d8d req-114a781a-8555-43e4-ab7c-e46655ee9edb service nova] Enqueued Resource ID: 40478db5-121a-427c-84db-08d463cefc2c with Priority: HIGHEST for action port [ 605.868536] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_rules [ 605.868814] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 605.869098] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40478db5-121a-427c-84db-08d463cefc2c with Priority: HIGHEST for action port [ 605.872041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.872041] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.872041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.872041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.872041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.873323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.873625] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.877328] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-40478db5-121a-427c-84db-08d463cefc2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.877328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.877328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.877328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.877328] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40478db5-121a-427c-84db-08d463cefc2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.164791] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7 [ 606.164791] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.164791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.164791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.164791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.164791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.164791] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7 already deleted. [ 606.164791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b4dac1-ffd3-4796-9ada-a3d21a2ca6e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.203533] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad710818-9f6b-4718-bff8-4836e8a61c3b: rpc.has_security_group_logging(os_id): False [ 606.219509] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-94af113b-87ae-4183-82aa-d10cb904cd60 tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 606.220319] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 606.220750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.220905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.221007] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.221408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.222133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.222133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.222381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.222449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.222541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.222644] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.228698] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.229646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.229646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.229646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.229646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.229985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.230090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.230090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.230256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.230346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.230702] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.230817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.231670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.231670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.232034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.232034] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b is going to be created. [ 606.348752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.349058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.349164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.349411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.349632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.368626] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: IN_PROGRESS for 2s [ 606.378259] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.378259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.379480] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.380156] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40478db5-121a-427c-84db-08d463cefc2c with status ACTIVE [ 606.381095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.381095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.381095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.383050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.383050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.383402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.383691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.383880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.384275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.384503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.385197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.385948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.385948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.386188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.386537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.386649] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40478db5-121a-427c-84db-08d463cefc2c is going to be updated. [ 606.440197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.440656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.440656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.441092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.441664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.441664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40478db5-121a-427c-84db-08d463cefc2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.725212] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.725465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.725581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.725859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.726021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.726291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.726436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.726537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.727073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.727073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.727073] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 already deleted. [ 606.727276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.869132] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-84a49a4e-7f28-4ed9-9a55-66877934ab60 tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 606.869820] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 606.870936] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.871187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.871557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.872752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.874234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.874501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.874581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.874826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.874959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.875091] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.890515] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.273953] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: SUCCESS [ 607.275612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.275612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.275834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.277782] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.277961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.278104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.278322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.278459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.278494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.278590] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.379840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.379840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.379840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.379840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.380167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.380167] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.380249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.380280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.380419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.380494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.380583] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 already deleted. [ 607.380673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.386592] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-54577344-7515-4e77-8be1-ad242198f329 tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 607.387326] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 607.387680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.387799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.388250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.388250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.388250] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.388411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.388411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.389697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.389697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.389697] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.394894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.395049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.395109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.395311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.395391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.395485] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 is going to be created. [ 607.425620] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.425712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.425712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.425948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.426078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.439299] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: UNINITIALIZED for 2s [ 607.784671] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.784916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.784916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.785196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.785401] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.785522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.785577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.785743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.785838] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.786658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.786658] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.786658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.786658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.786658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.786658] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.787100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.787100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.787100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.787100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.787274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.787274] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.893587] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.894733] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.894733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.895099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 already deleted. [ 607.895099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.910824] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.911042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.911169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.911799] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.912366] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.912552] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.912672] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.912907] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.913067] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.913270] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.913398] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.913499] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.913787] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.913947] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.914112] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.914275] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.948032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.948272] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.948368] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.948476] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.948846] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-bff7c47c-44ca-49cf-918d-59d1477bdaaa taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.949035] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.949145] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.949485] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.949622] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff7c47c-44ca-49cf-918d-59d1477bdaaa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.215325] env[65738]: INFO networking_nsxv3.common.synchronization [req-16fb606c-8f7d-44ca-9505-2f2fdf7d295c req-04d78a04-c063-4c8f-a8af-ae2c2d32f318 tempest-DeleteServersAdminTestJSON-1617035486 tempest-DeleteServersAdminTestJSON-1617035486-project-admin] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 608.215915] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 608.216652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.216784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.216853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.217068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.217249] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.217349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.217410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.217562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.217647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.217740] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.294709] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47750d4b-22bd-42e5-bf36-3cc17e08c0a0: rpc.has_security_group_logging(os_id): False [ 608.313052] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.313203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.313251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.313469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.313600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.313823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.313911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.313967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.314134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.314234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.314416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.314561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.314705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.314856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.314935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.315134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.315238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.315313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.315547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.315625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.315710] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 is going to be created. [ 608.400026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.400026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.400026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.400026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.400026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.400955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: SUCCESS [ 608.401366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.413289] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: IN_PROGRESS for 2s [ 608.452556] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.452556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.452556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.452556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.452556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.452879] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port bff7c47c-44ca-49cf-918d-59d1477bdaaa not found, creating... [ 608.452924] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.454033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.454033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.454033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.454033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.454033] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.454033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.454398] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.454398] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.454474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.454609] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: bff7c47c-44ca-49cf-918d-59d1477bdaaa is going to be created. [ 608.483053] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.483277] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.483397] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.483814] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.484065] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.484308] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.719686] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.719815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.719908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.720182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.720287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.720928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.721045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.721108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.721387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.721474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.721733] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be updated. [ 608.756767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.757235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.757378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.757623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.757789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.776708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 609.149105] env[65738]: INFO networking_nsxv3.common.synchronization [req-d843769e-4f05-41a6-a760-e0c12f650926 req-74f4cb07-abc2-4b53-8eaf-47c0de9f00ec tempest-VolumesAssistedSnapshotsTest-42197642 tempest-VolumesAssistedSnapshotsTest-42197642-project-member] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 609.149105] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 609.149105] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.149105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.150532] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.150532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.151054] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.220864] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b85b2c25-ff91-472b-ab81-fd2a78e52a63 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 609.221058] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b85b2c25-ff91-472b-ab81-fd2a78e52a63 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 609.221209] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b85b2c25-ff91-472b-ab81-fd2a78e52a63 service nova] Enqueued Resource ID: bff7c47c-44ca-49cf-918d-59d1477bdaaa with Priority: HIGHEST for action port [ 609.221494] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 609.221692] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 609.221739] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff7c47c-44ca-49cf-918d-59d1477bdaaa with Priority: HIGHEST for action port [ 609.222534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.222668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.222736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.222999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.223102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.224502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.224617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.224683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.225793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.225793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.225793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.225793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.226058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.226058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.226058] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.228075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff7c47c-44ca-49cf-918d-59d1477bdaaa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.228075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.228075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.228075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.228075] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff7c47c-44ca-49cf-918d-59d1477bdaaa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.455772] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: SUCCESS [ 609.456211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.456211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.456374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.456516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.456656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.456755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.457029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.457029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.457029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.457247] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.593959] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-44 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.594179] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-44" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.594330] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-44" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.594625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-44" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.595034] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.595249] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.595349] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.595574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.595722] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.595920] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.596044] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.596238] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.596308] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.596411] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.596449] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.596579] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.620987] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.621315] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.621482] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.621705] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-44" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.622080] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.622315] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.622455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.622810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.622965] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1867526-dfd7-495a-bc1c-1c70ce5eadc4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.653220] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.653419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.653602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.653802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.653926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.654225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.654629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.654629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.654629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.654932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.654932] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd already deleted. [ 609.654932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.729857] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bff7c47c-44ca-49cf-918d-59d1477bdaaa with status ACTIVE [ 609.730683] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.731115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.731115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.731115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.731324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.731462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.731636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.731636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.731722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.731787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.731979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.732166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.732224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.732474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.732528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.732562] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bff7c47c-44ca-49cf-918d-59d1477bdaaa is going to be updated. [ 609.733893] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.734019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.734228] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.767219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.767409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.767409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.767946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.767946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.767946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff7c47c-44ca-49cf-918d-59d1477bdaaa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.965616] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.965857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.965857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.966173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.966294] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.966380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.966422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.966557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.966635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966874] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.966967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.967070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.967192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.967336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.967418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.967510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.967605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.967683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.967762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.967850] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.027476] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.027671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-270" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.027788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-270" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.028126] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-270" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.028395] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.028551] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.028663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.028867] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.029009] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.029238] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.029352] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.029454] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.029556] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.029662] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.029759] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.029889] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.050373] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.050373] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.050373] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.050621] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-270" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.050842] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.051018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.051138] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.051501] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.051639] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986ff090-8f9c-4d6b-8e14-5fc0e88f98c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.126065] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.126372] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.126518] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.126877] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.127092] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.127269] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port d1867526-dfd7-495a-bc1c-1c70ce5eadc4 not found, creating... [ 610.127560] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.127754] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.127902] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.128180] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.128335] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.128691] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.128879] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.129014] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.129348] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.129540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.129725] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: d1867526-dfd7-495a-bc1c-1c70ce5eadc4 is going to be created. [ 610.151490] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.151701] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.151822] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.152133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.152362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.152586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.236481] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.432534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: SUCCESS [ 610.432789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.471437] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c7d7f2c-977a-4487-9860-998b141f77f2: rpc.has_security_group_logging(os_id): False [ 610.496816] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.497070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.497070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.497255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.497347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.497565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.497670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.497738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.497881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.497959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.498162] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.498257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.498306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.498760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.498760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.498760] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.498760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.498994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.498994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.498994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.499157] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 is going to be created. [ 610.554842] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.555228] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.555398] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.555788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.555928] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.556100] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 not found, creating... [ 610.556492] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.556670] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.556786] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.557131] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.557300] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.557650] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.557877] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.558011] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.558257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.558467] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.558657] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 is going to be created. [ 610.590442] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.590871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.590977] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.591484] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.591823] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.592168] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.603641] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.603860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.603860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.604078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.604382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.637680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: IN_PROGRESS for 2s [ 610.739698] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.739929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.739975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.740259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.740396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.740550] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be created. [ 610.791672] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 610.791931] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c deletion is rescheduled due to dependency. [ 610.791997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.832273] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.832494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.832494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.832787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.833084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.859718] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: UNINITIALIZED for 2s [ 610.916853] env[65738]: INFO networking_nsxv3.common.synchronization [req-d843769e-4f05-41a6-a760-e0c12f650926 req-0bb5d43c-190b-40d6-ac80-96cddcfc8aec service nova] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 610.917090] env[65738]: INFO networking_nsxv3.common.synchronization [req-d843769e-4f05-41a6-a760-e0c12f650926 req-0bb5d43c-190b-40d6-ac80-96cddcfc8aec service nova] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 610.917268] env[65738]: INFO networking_nsxv3.common.synchronization [req-d843769e-4f05-41a6-a760-e0c12f650926 req-0bb5d43c-190b-40d6-ac80-96cddcfc8aec service nova] Enqueued Resource ID: d1867526-dfd7-495a-bc1c-1c70ce5eadc4 with Priority: HIGHEST for action port [ 610.918019] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_rules [ 610.918142] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 610.918309] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1867526-dfd7-495a-bc1c-1c70ce5eadc4 with Priority: HIGHEST for action port [ 610.918667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.918799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.918949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.919532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.919532] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.920534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.920668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.920736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.920983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.921188] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.922541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.922541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.923155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.923155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.923155] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.931025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.931328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.931328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.931613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.931703] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1867526-dfd7-495a-bc1c-1c70ce5eadc4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.326250] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b082d617-94f1-414a-ab37-4e5ac527d4c9 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 611.326424] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b082d617-94f1-414a-ab37-4e5ac527d4c9 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 611.326595] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-b082d617-94f1-414a-ab37-4e5ac527d4c9 service nova] Enqueued Resource ID: 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 with Priority: HIGHEST for action port [ 611.327651] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 611.327845] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 611.328240] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 with Priority: HIGHEST for action port [ 611.328391] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.328620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.328832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.328999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329304] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.329468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.329856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.329967] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986ff090-8f9c-4d6b-8e14-5fc0e88f98c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.436744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1867526-dfd7-495a-bc1c-1c70ce5eadc4 with status ACTIVE [ 611.436744] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.436744] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.436744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.437692] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.437692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.437692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.437692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.437692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.437692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1867526-dfd7-495a-bc1c-1c70ce5eadc4 is going to be updated. [ 611.441932] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.441932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.441932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.463148] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.463322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.463434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.463675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.463841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.464252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1867526-dfd7-495a-bc1c-1c70ce5eadc4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.502170] env[65738]: INFO networking_nsxv3.common.synchronization [req-3d95886a-8282-4a73-bb64-0c9bb92bf902 req-3ab60f10-5152-4664-b175-b5b2010bbc92 tempest-ServerDiagnosticsTest-1343836444 tempest-ServerDiagnosticsTest-1343836444-project-member] Enqueued Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 611.503090] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 611.503581] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.503774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.503883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.504272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.504922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.504922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.504922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.505186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.505272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.505423] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.832294] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 with status ACTIVE [ 611.832875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.833069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.833139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.833383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.833471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.833660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.833775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.833876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.833993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.834104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.834358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.834456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.834456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.834610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.834685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.834786] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 986ff090-8f9c-4d6b-8e14-5fc0e88f98c0 is going to be updated. [ 611.869213] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.869213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.869213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.869213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.869699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.873857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986ff090-8f9c-4d6b-8e14-5fc0e88f98c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.939668] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.939960] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.940067] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.940352] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.940626] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.940786] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.940932] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.941189] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.941448] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.941724] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.942189] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.942348] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.942500] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.942573] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.942674] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.942811] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.944495] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.993696] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.993696] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.993825] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.994049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.994394] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-c6745c43-ee12-4e3a-aa99-69921f036567 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.994614] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.994753] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.995144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.995292] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6745c43-ee12-4e3a-aa99-69921f036567',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.008345] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.008542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.008589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.008865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.008980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.009276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.009464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.009464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.009647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.009809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.009809] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd already deleted. [ 612.009953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.148513] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.148705] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.148844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.149161] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.149471] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.149651] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.149787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.150047] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.150197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.150403] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.150516] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.150617] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.150718] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.150822] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.150921] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.151063] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.175961] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.176103] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.176203] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.176377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-720" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.176911] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.177174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.177174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.177532] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.177745] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af8c9300-9a4d-4627-81b1-9a190ffb5ec1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.447150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.447420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.447420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.447750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.447910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.448053] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd is going to be created. [ 612.479606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.479823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.479891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.480176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.480418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.493656] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: UNINITIALIZED for 2s [ 612.497420] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.497679] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.497829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.498125] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.498282] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.498469] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port c6745c43-ee12-4e3a-aa99-69921f036567 not found, creating... [ 612.498755] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.498936] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.499127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.499346] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.499510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.499835] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.500018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.500153] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.500416] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.500527] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.500680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: c6745c43-ee12-4e3a-aa99-69921f036567 is going to be created. [ 612.526764] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.527189] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.527189] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.527404] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.527608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.527873] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.667340] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: SUCCESS [ 612.667765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.681681] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.682037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.682245] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.682639] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.682839] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.683099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port af8c9300-9a4d-4627-81b1-9a190ffb5ec1 not found, creating... [ 612.683840] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.684088] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.684586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.684586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.684801] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.685221] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.685394] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.685519] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.685799] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.686038] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.686101] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: af8c9300-9a4d-4627-81b1-9a190ffb5ec1 is going to be created. [ 612.732293] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.732581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.732671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.732945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.733302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.733563] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.883589] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 612.883897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.884232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.884613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.884891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.885041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.885120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.885300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.885398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.885535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.885686] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.886955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.886955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.887194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.887289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.887338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.887456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.887539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.887633] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.218292] env[65738]: INFO networking_nsxv3.common.synchronization [req-3d95886a-8282-4a73-bb64-0c9bb92bf902 req-f6f94d78-771c-4852-acef-a03be000667b service nova] Enqueued Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_rules [ 613.219113] env[65738]: INFO networking_nsxv3.common.synchronization [req-3d95886a-8282-4a73-bb64-0c9bb92bf902 req-f6f94d78-771c-4852-acef-a03be000667b service nova] Enqueued Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 613.219113] env[65738]: INFO networking_nsxv3.common.synchronization [req-3d95886a-8282-4a73-bb64-0c9bb92bf902 req-f6f94d78-771c-4852-acef-a03be000667b service nova] Enqueued Resource ID: c6745c43-ee12-4e3a-aa99-69921f036567 with Priority: HIGHEST for action port [ 613.219879] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_rules [ 613.220074] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 613.220193] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6745c43-ee12-4e3a-aa99-69921f036567 with Priority: HIGHEST for action port [ 613.220978] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.220978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.220978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.220978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.221190] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.222296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.222296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.222404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.223317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.223317] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.223317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.223317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.223317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.223317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.225216] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.228220] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6745c43-ee12-4e3a-aa99-69921f036567 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.228220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.228220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.228488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.228488] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6745c43-ee12-4e3a-aa99-69921f036567',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.391040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.391040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.391040] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.505946] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-f9a53143-acc0-4bc1-88d0-703e11e19829 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 613.506143] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-f9a53143-acc0-4bc1-88d0-703e11e19829 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 613.506287] env[65738]: INFO networking_nsxv3.common.synchronization [req-d66a7283-8e67-45f0-911c-0182e7de8c46 req-f9a53143-acc0-4bc1-88d0-703e11e19829 service nova] Enqueued Resource ID: af8c9300-9a4d-4627-81b1-9a190ffb5ec1 with Priority: HIGHEST for action port [ 613.506868] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 613.506998] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 613.507786] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af8c9300-9a4d-4627-81b1-9a190ffb5ec1 with Priority: HIGHEST for action port [ 613.507786] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.507786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.508143] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.508259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.509912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.509912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.509912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.509912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.509912] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af8c9300-9a4d-4627-81b1-9a190ffb5ec1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.732709] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.735143] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.736411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.736924] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6745c43-ee12-4e3a-aa99-69921f036567 with status ACTIVE [ 613.737834] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.737834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.737834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.737834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.738107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.738146] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.738766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.738766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.738766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.738766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.738986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.738986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.739151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.739473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.739473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.739473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6745c43-ee12-4e3a-aa99-69921f036567 is going to be updated. [ 613.766366] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.766521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.766685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.766784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.766920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.767096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6745c43-ee12-4e3a-aa99-69921f036567" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.894562] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.011781] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af8c9300-9a4d-4627-81b1-9a190ffb5ec1 with status ACTIVE [ 614.012039] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.012148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.012220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.012409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.012501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.012682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.012784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.012843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.012998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.013090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.013274] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.013370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.013427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.013663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.013741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.013830] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af8c9300-9a4d-4627-81b1-9a190ffb5ec1 is going to be updated. [ 614.038626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.038626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.038626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.038626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.038626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.038626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af8c9300-9a4d-4627-81b1-9a190ffb5ec1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.074738] env[65738]: INFO networking_nsxv3.common.synchronization [req-d753c237-c41d-4bdd-acb8-83e86e3deb36 req-0ffe18cb-db03-40c7-a1ba-48aca9180775 tempest-SecurityGroupRulesNegativeTestJSON-1169932515 tempest-SecurityGroupRulesNegativeTestJSON-1169932515-project-member] Enqueued Resource ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 with Priority: HIGHEST for action security_group_rules [ 614.075555] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 with Priority: HIGHEST for action security_group_rules [ 614.076013] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca4a68f2-2721-4966-9941-4e15532e9ad5 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.076282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.076462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.076799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.076974] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca4a68f2-2721-4966-9941-4e15532e9ad5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.238802] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.399188] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.399188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.399188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.400893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.400893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.400893] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 614.435495] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.435690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.435826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.436693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.437098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.449429] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 614.519913] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: SUCCESS [ 614.520327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.521416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.521416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.521416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.521416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.521416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.521822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.521822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.521822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.521945] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.601589] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.601856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.601856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.602134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.602311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.602378] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 already deleted. [ 614.602508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.740691] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.741041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.741041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.741125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.741161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.741277] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd is going to be created. [ 614.797872] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.798099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.798150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.798363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.799050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.823264] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: UNINITIALIZED for 2s [ 615.024957] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.530931] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f8f014-13fa-4be1-97eb-834dadab33fd: rpc.has_security_group_logging(os_id): False [ 615.568859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.568859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd is going to be created. [ 615.677991] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.677991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.677991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.678361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.678639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.702331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: IN_PROGRESS for 2s [ 616.172223] env[65738]: INFO networking_nsxv3.common.synchronization [req-28dd826d-1d59-4dfd-abe8-dd1138f17636 req-d8f002c5-7935-4e2c-a297-20ea2359854a tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 616.172916] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 616.173846] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.173998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.174055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.177051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.177051] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.177051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.177051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.177051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.177051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.177051] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.467107] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.467107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.467107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.467107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.467107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.468842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.468906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.469115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.469175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.469333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.469434] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.470776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.470962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.471154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.471331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.471416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.471619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.471741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.471881] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.681278] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.681566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.681566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.681782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.682232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.682232] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.682232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.682232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.682445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.682445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.682508] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 already deleted. [ 616.682575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.795049] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.795257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.795435] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.795711] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.795974] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.796151] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.796256] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.796502] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.796634] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.796846] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.796944] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.797051] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.797157] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.797247] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.797343] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.797548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.821893] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.822112] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.822205] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.822452] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.822843] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-30170c6d-2296-4b53-919b-bfb48fef3835 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.823069] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.823226] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.823668] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.823828] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30170c6d-2296-4b53-919b-bfb48fef3835',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.837744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: SUCCESS [ 616.838029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.838380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.838380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.838608] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.838668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.838754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.838865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.838947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.839048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.839227] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.974590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194d1d45-daf3-4873-a0c4-a279f2704021: rpc.has_security_group_logging(os_id): False [ 616.976952] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.003436] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.003436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.003436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.003951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.003951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.003951] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.003951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.004145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.004178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.004866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.004866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.004866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.004866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.005076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.005076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.005218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.005390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.005459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.005636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.005711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.005798] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be created. [ 617.088025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.105803] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 617.329518] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.329884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.329884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.330141] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.330284] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.330431] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 30170c6d-2296-4b53-919b-bfb48fef3835 not found, creating... [ 617.330686] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.330840] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.330954] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.331369] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.331487] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.331805] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.331991] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.332121] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.332362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.332466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.332601] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 30170c6d-2296-4b53-919b-bfb48fef3835 is going to be created. [ 617.342631] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.342907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.343054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.343381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.343660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.343920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.343998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.344245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.344403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.344576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.344837] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.344996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.345128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.345373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.345640] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.345781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.345924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.346182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.346436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.346602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.346845] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.363018] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.363255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.363380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.363717] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.363952] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.364223] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.481828] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.721495] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: SUCCESS [ 617.721801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.849013] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for beba0424-1a8e-44c6-90d2-7d725d4330cd: rpc.has_security_group_logging(os_id): False [ 617.871463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.871547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.871625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.871823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.871911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.872113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.872245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.872345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.873149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.873149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.873149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.873149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.873149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.873390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.873539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.873787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.873975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.873975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.874108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.874168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.874258] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd is going to be created. [ 617.939900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.940083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.940156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.940375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.940557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.963629] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: IN_PROGRESS for 2s [ 617.983660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.983809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.983809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.984017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.984124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.984377] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [req-28dd826d-1d59-4dfd-abe8-dd1138f17636 req-23636fbc-61fe-4f37-805f-93a4cdda79b0 service nova] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [req-28dd826d-1d59-4dfd-abe8-dd1138f17636 req-23636fbc-61fe-4f37-805f-93a4cdda79b0 service nova] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [req-28dd826d-1d59-4dfd-abe8-dd1138f17636 req-23636fbc-61fe-4f37-805f-93a4cdda79b0 service nova] Enqueued Resource ID: 30170c6d-2296-4b53-919b-bfb48fef3835 with Priority: HIGHEST for action port [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 618.070027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30170c6d-2296-4b53-919b-bfb48fef3835 with Priority: HIGHEST for action port [ 618.070027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.070866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.071117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.071753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.072098] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.073339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.073868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.073868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.075028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.075028] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.075028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.075028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.075028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.075028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.075028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.078701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-30170c6d-2296-4b53-919b-bfb48fef3835 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.078701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.078701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.078701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.078701] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30170c6d-2296-4b53-919b-bfb48fef3835',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.105030] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.105030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.105030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.105030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.105030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.122836] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 618.407947] env[65738]: INFO networking_nsxv3.common.synchronization [req-c99904ee-950f-41ba-99e7-30e48954696a req-a4c20d38-bf8f-40a6-8720-ef9ab086784c tempest-InstanceActionsV221TestJSON-1331516356 tempest-InstanceActionsV221TestJSON-1331516356-project-member] Enqueued Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 618.409225] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 618.409546] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.409671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.409738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.410014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.410179] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.410284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.410346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.410496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.410581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.410676] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.579439] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.579888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.579888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.580851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30170c6d-2296-4b53-919b-bfb48fef3835 with status ACTIVE [ 618.581080] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.581299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.581437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.581609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.581707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.581934] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.582103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.582187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.582364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.582452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.582695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.582854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.582947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.583297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.583297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.583470] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30170c6d-2296-4b53-919b-bfb48fef3835 is going to be updated. [ 618.607271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.607271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.607554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.608142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.608142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.608142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30170c6d-2296-4b53-919b-bfb48fef3835" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.915871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.915871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.915871] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c already deleted. [ 618.915871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.937834] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.938930] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-201" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.938930] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-201" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.940059] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-201" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.940059] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.940254] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.940362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.940682] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.940847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.941076] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.941224] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.941302] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.941406] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.941511] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.941611] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.941746] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.964297] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.964467] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.964592] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.964969] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-201" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.965183] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-7a2faec6-a76c-4a36-9344-996de569d92d taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.965360] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.965474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.965823] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.966012] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a2faec6-a76c-4a36-9344-996de569d92d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.085367] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.126031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 619.126338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.126555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.126845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.126954] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.470507] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.470933] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.470933] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.471023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.471183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.471853] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 7a2faec6-a76c-4a36-9344-996de569d92d not found, creating... [ 619.471974] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.472194] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.472314] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.472557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.472699] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.473013] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.473379] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.473379] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.473492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.473617] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.473753] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 7a2faec6-a76c-4a36-9344-996de569d92d is going to be created. [ 619.503271] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.503271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.503271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.503271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.503271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.503271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.582094] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a9bfd31d-cd7d-4303-8c6c-3d2613361655 None None] Enqueued Resource ID: 8d5014b9-243d-47f6-b623-5965c7b3831f with Priority: HIGHEST for action port [ 619.582700] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5014b9-243d-47f6-b623-5965c7b3831f with Priority: HIGHEST for action port [ 619.583018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d5014b9-243d-47f6-b623-5965c7b3831f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.583144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d5014b9-243d-47f6-b623-5965c7b3831f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.583203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d5014b9-243d-47f6-b623-5965c7b3831f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.583498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d5014b9-243d-47f6-b623-5965c7b3831f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.583599] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d5014b9-243d-47f6-b623-5965c7b3831f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.588502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.588502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.588674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.588740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.588867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.588917] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be created. [ 619.629726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.630014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.630014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.630192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.630248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.631476] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.631626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.642856] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: UNINITIALIZED for 2s [ 619.979137] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: SUCCESS [ 619.979546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.088700] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d5014b9-243d-47f6-b623-5965c7b3831f [ 620.089698] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.090295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.090295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.090408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.090546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.090672] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d5014b9-243d-47f6-b623-5965c7b3831f already deleted. [ 620.090782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d5014b9-243d-47f6-b623-5965c7b3831f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.136331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 620.136560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.136736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.136965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.137177] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.137300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.137365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.137521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.137601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.137687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.138067] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.242821] env[65738]: INFO networking_nsxv3.common.synchronization [req-c99904ee-950f-41ba-99e7-30e48954696a req-773b65e7-4cea-44c1-961a-07e3230aacaf service nova] Enqueued Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_rules [ 620.242986] env[65738]: INFO networking_nsxv3.common.synchronization [req-c99904ee-950f-41ba-99e7-30e48954696a req-773b65e7-4cea-44c1-961a-07e3230aacaf service nova] Enqueued Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 620.243127] env[65738]: INFO networking_nsxv3.common.synchronization [req-c99904ee-950f-41ba-99e7-30e48954696a req-773b65e7-4cea-44c1-961a-07e3230aacaf service nova] Enqueued Resource ID: 7a2faec6-a76c-4a36-9344-996de569d92d with Priority: HIGHEST for action port [ 620.243690] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_rules [ 620.243816] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 620.243910] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2faec6-a76c-4a36-9344-996de569d92d with Priority: HIGHEST for action port [ 620.244681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.244822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.244871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.245288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.245288] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.246137] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.246386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.246465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.246661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.246828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.246921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.246977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.247145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.247230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.247323] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.249440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a2faec6-a76c-4a36-9344-996de569d92d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.249552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.249602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.249903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.250027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a2faec6-a76c-4a36-9344-996de569d92d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.640321] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.640712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.640712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.640868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.641028] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.641147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.641260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.642047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.642047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.642047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.642047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.642047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.642047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.642368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.642368] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.642368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.642467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.642686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.642686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.642769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.642811] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.758822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.758822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.759151] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.760735] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a2faec6-a76c-4a36-9344-996de569d92d with status ACTIVE [ 620.760735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.760907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.760907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.761533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.761533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.761533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.761533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.762745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.770027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.770027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.770027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a2faec6-a76c-4a36-9344-996de569d92d is going to be updated. [ 620.796655] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.796655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.796655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.796655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.796655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.796655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a2faec6-a76c-4a36-9344-996de569d92d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.145012] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194d1d45-daf3-4873-a0c4-a279f2704021: rpc.has_security_group_logging(os_id): False [ 621.166246] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.166246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.166588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.166588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.166715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.166884] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.167152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.167152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.167319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.167319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.167929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.167929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.168172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.168232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.168284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.168583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.168661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.168833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.168917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.169033] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 621.246237] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.246237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.246237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.246513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.246513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.269808] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 621.271346] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.656750] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.656750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.656750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.656750] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.775180] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.775358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.775412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.775636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.775728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.775829] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c is going to be created. [ 621.817505] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.817721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.817772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.818372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.818372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.836799] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: UNINITIALIZED for 2s [ 622.133990] env[65738]: INFO networking_nsxv3.common.synchronization [None req-10b24b32-887b-48d5-9381-e784566a65e5 None None] Enqueued Resource ID: a8edb0ad-82ef-4714-8f8a-1897acc9a7f6 with Priority: HIGHEST for action port [ 622.135415] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8edb0ad-82ef-4714-8f8a-1897acc9a7f6 with Priority: HIGHEST for action port [ 622.135909] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8edb0ad-82ef-4714-8f8a-1897acc9a7f6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.136056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8edb0ad-82ef-4714-8f8a-1897acc9a7f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.136118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8edb0ad-82ef-4714-8f8a-1897acc9a7f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.136402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8edb0ad-82ef-4714-8f8a-1897acc9a7f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.136494] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8edb0ad-82ef-4714-8f8a-1897acc9a7f6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.158935] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.476902] env[65738]: INFO networking_nsxv3.common.synchronization [req-575f6c6f-683c-4860-80bf-92668455f790 req-6d922eb7-4770-478b-9acf-521364643bd4 tempest-SecurityGroupRulesNegativeTestJSON-1169932515 tempest-SecurityGroupRulesNegativeTestJSON-1169932515-project-member] Enqueued Resource ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 with Priority: HIGHEST for action security_group_rules [ 622.480468] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 with Priority: HIGHEST for action security_group_rules [ 622.480468] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca4a68f2-2721-4966-9941-4e15532e9ad5 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.480468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.480468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.480468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.480468] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca4a68f2-2721-4966-9941-4e15532e9ad5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.641101] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8edb0ad-82ef-4714-8f8a-1897acc9a7f6 [ 622.641101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.641101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.641101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.641101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.641101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.641101] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8edb0ad-82ef-4714-8f8a-1897acc9a7f6 already deleted. [ 622.641101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8edb0ad-82ef-4714-8f8a-1897acc9a7f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.664569] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f6f7207-78fd-4f30-bb10-327e2c3450e8: rpc.has_security_group_logging(os_id): False [ 622.688029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.688029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.688029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.688029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be created. [ 622.753773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.753926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.753997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.754232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.754411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.769839] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: IN_PROGRESS for 2s [ 622.854916] env[65738]: INFO networking_nsxv3.common.synchronization [req-7f34787f-60dc-4a6d-ae90-655f14b3f3f8 req-f8ddf409-348b-4970-be96-21f343b62757 tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 622.856101] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 622.856101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65a4b858-8274-4685-ac5f-65db94efa8d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.856316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.856316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.857483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.857483] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65a4b858-8274-4685-ac5f-65db94efa8d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.002313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.002647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.002647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.002869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.004867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.004867] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca4a68f2-2721-4966-9941-4e15532e9ad5 already deleted. [ 623.004867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca4a68f2-2721-4966-9941-4e15532e9ad5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.291465] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 623.291712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.292321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.292321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.292437] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.385097] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.385723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.386147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.386445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.386654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.386791] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 already deleted. [ 623.386926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.797703] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.798511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.798673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.798974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.800169] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.800169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.800169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.800169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.800169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.800442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.800479] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.852185] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: SUCCESS [ 623.852185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.852357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.852687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.852998] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.853223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.853320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.853615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.853785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.853925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.854063] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.304458] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.307776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.307776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.307776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.307776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.308806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.308806] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.358530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.358696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.358747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.358958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.359170] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.359292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.359358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.359519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.359608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.359699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.359850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.359944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.360011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.360160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.360305] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.360399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.360458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.360587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.360660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.360728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.360844] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.783107] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 624.783531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.812824] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194d1d45-daf3-4873-a0c4-a279f2704021: rpc.has_security_group_logging(os_id): False [ 624.851079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.851079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.851079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.851079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.851659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.851659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.851659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.851659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.851779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.851885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.851993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.852121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.852159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.852889] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 624.865473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c: rpc.has_security_group_logging(os_id): False [ 624.896032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.896802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.896802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896802] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c is going to be created. [ 624.927102] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.927102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.927102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.927102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.927102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.946585] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 625.009029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.009029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.009029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.009029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.009029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.034361] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: IN_PROGRESS for 2s [ 626.084939] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3f9dc1f-b1dc-4cba-9167-c13cb701b9c3 req-faa0f216-2fbf-458e-9c60-4a3dcc19f932 tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 626.085367] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 626.085367] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65a4b858-8274-4685-ac5f-65db94efa8d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.085473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.085511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.085717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.085793] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65a4b858-8274-4685-ac5f-65db94efa8d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.616979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.617229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.617229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.617514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.617596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.617692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 already deleted. [ 626.617818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.966611] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 626.966987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.975811] env[65738]: INFO networking_nsxv3.common.synchronization [req-2850b314-02b0-4546-ae2a-742f94af4ff6 req-618aa231-2844-4d63-ae7e-72be08c00d1e tempest-ServerDiagnosticsNegativeTest-151714200 tempest-ServerDiagnosticsNegativeTest-151714200-project-member] Enqueued Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 626.977089] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGHEST for action security_group_members [ 626.977606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.977800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.977905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.978292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.978558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.978955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.978955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.979095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.979219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.979359] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.053078] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: SUCCESS [ 627.053078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.484097] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.484097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.484679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.484679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.484907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.485137] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.485288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.485288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.485510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.485586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.485637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b is going to be updated. [ 627.520961] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.520961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.521248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.521314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.521731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.536252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: IN_PROGRESS for 2s [ 628.820266] env[65738]: INFO networking_nsxv3.common.synchronization [None req-8f2f04bb-f987-414e-a050-f8293fe839f1 None None] Enqueued Resource ID: d26b1ead-0ff7-492f-bd50-93e692b57031 with Priority: HIGHEST for action port [ 628.821153] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26b1ead-0ff7-492f-bd50-93e692b57031 with Priority: HIGHEST for action port [ 628.823584] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26b1ead-0ff7-492f-bd50-93e692b57031 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.823791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26b1ead-0ff7-492f-bd50-93e692b57031" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.824497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26b1ead-0ff7-492f-bd50-93e692b57031" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.824497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26b1ead-0ff7-492f-bd50-93e692b57031" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.824497] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26b1ead-0ff7-492f-bd50-93e692b57031',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.979653] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6a15303c-6712-434d-958c-0f0ef7438f05 None None] Enqueued Resource ID: ea31aa5e-339b-4704-8997-65f2c9e0bbca with Priority: HIGHEST for action port [ 628.980928] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea31aa5e-339b-4704-8997-65f2c9e0bbca with Priority: HIGHEST for action port [ 628.981797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea31aa5e-339b-4704-8997-65f2c9e0bbca taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.981953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea31aa5e-339b-4704-8997-65f2c9e0bbca" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.982432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea31aa5e-339b-4704-8997-65f2c9e0bbca" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.984404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea31aa5e-339b-4704-8997-65f2c9e0bbca" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.984798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea31aa5e-339b-4704-8997-65f2c9e0bbca',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.327495] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d26b1ead-0ff7-492f-bd50-93e692b57031 [ 629.329068] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.329068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.329068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.329068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.329068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.329068] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d26b1ead-0ff7-492f-bd50-93e692b57031 already deleted. [ 629.329068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26b1ead-0ff7-492f-bd50-93e692b57031" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.468143] env[65738]: INFO networking_nsxv3.common.synchronization [req-d9cb9b35-c178-4bb5-91df-95cb12c4b787 req-033ad1b5-2248-4bab-ab5b-8a8251287f6d tempest-ServerExternalEventsTest-267735185 tempest-ServerExternalEventsTest-267735185-project-member] Enqueued Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 629.468540] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGHEST for action security_group_members [ 629.468930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.469134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.469134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.469395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.469518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.469609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.469669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.469819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.469905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.470128] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.489742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea31aa5e-339b-4704-8997-65f2c9e0bbca [ 629.490571] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.490571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.490571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.490829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.491039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.491108] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea31aa5e-339b-4704-8997-65f2c9e0bbca already deleted. [ 629.491314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea31aa5e-339b-4704-8997-65f2c9e0bbca" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.550448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad710818-9f6b-4718-bff8-4836e8a61c3b in Status: SUCCESS [ 629.551110] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b deletion is rescheduled due to dependency. [ 629.551110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.972515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.972900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.972900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.973047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.973086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.973276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.973377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.973439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.973606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.973706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.973742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 is going to be updated. [ 630.019425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.019580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.019633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.019844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.019975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.030875] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: IN_PROGRESS for 2s [ 630.667382] env[65738]: INFO networking_nsxv3.common.synchronization [req-a955e9a1-23dd-4c80-89d2-f8282fa55edf req-aeb9563c-93ca-4016-8cd0-1b448ef776fc tempest-DeleteServersAdminTestJSON-2077497370 tempest-DeleteServersAdminTestJSON-2077497370-project-member] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 630.667438] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 630.667743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.667861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.667925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.670095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.670356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.670417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.670487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.670676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.670797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.670861] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.767503] env[65738]: INFO networking_nsxv3.common.synchronization [None req-ee130fd8-bee4-4146-b93a-18b654c3a54a None None] Enqueued Resource ID: 94912d65-0cab-44a6-8075-7439634b7027 with Priority: HIGHEST for action port [ 630.768400] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94912d65-0cab-44a6-8075-7439634b7027 with Priority: HIGHEST for action port [ 630.768968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-94912d65-0cab-44a6-8075-7439634b7027 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.769311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94912d65-0cab-44a6-8075-7439634b7027" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.769363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94912d65-0cab-44a6-8075-7439634b7027" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.771968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94912d65-0cab-44a6-8075-7439634b7027" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.771968] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94912d65-0cab-44a6-8075-7439634b7027',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.175127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.175478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.175478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.175658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.175658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.175875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.175972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.176019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.176279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.176397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.176540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be updated. [ 631.210815] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.211046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.211046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.211406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.211516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.224942] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 631.272584] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94912d65-0cab-44a6-8075-7439634b7027 [ 631.273211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.273211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.273211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.273211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.273850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.273850] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94912d65-0cab-44a6-8075-7439634b7027 already deleted. [ 631.273850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94912d65-0cab-44a6-8075-7439634b7027" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.605257] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.605467] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.605580] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.605990] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.606234] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.606456] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.606534] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.607855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.607855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.607855] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.607855] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.607855] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.607855] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.607855] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.607855] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.607855] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.634071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.634338] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.634403] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.634556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.634883] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-43c38e03-75cf-472e-acc9-5dfcaef63c32 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.635073] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.635191] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.635582] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.635667] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c38e03-75cf-472e-acc9-5dfcaef63c32',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.648243] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5a45ec10-a915-452b-ae12-9008b265cfdb None None] Enqueued Resource ID: 08898fbd-dcb7-49dd-80f5-7cfce88402bb with Priority: HIGHEST for action port [ 631.649129] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08898fbd-dcb7-49dd-80f5-7cfce88402bb with Priority: HIGHEST for action port [ 631.649724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-08898fbd-dcb7-49dd-80f5-7cfce88402bb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.649724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08898fbd-dcb7-49dd-80f5-7cfce88402bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.649939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08898fbd-dcb7-49dd-80f5-7cfce88402bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.650380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08898fbd-dcb7-49dd-80f5-7cfce88402bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.650484] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08898fbd-dcb7-49dd-80f5-7cfce88402bb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.991706] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d0110d98-720a-4fb7-b63d-d4e8aeb1284e None None] Enqueued Resource ID: ebce5b78-ba5c-44eb-bca7-25392e0b6c55 with Priority: HIGHEST for action port [ 631.992314] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebce5b78-ba5c-44eb-bca7-25392e0b6c55 with Priority: HIGHEST for action port [ 631.992684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebce5b78-ba5c-44eb-bca7-25392e0b6c55 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.992814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebce5b78-ba5c-44eb-bca7-25392e0b6c55" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.992858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebce5b78-ba5c-44eb-bca7-25392e0b6c55" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.993149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebce5b78-ba5c-44eb-bca7-25392e0b6c55" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.993904] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebce5b78-ba5c-44eb-bca7-25392e0b6c55',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.042313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 in Status: SUCCESS [ 632.042313] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 deletion is rescheduled due to dependency. [ 632.042313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.140970] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.141197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.141534] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.141637] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.141779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.141931] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 43c38e03-75cf-472e-acc9-5dfcaef63c32 not found, creating... [ 632.142213] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.142373] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.142486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.142702] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.142834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.145270] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.145270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.145270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.145270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.145270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.145563] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 43c38e03-75cf-472e-acc9-5dfcaef63c32 is going to be created. [ 632.155332] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08898fbd-dcb7-49dd-80f5-7cfce88402bb [ 632.155332] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.155332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.155332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.155332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.155332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.155332] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08898fbd-dcb7-49dd-80f5-7cfce88402bb already deleted. [ 632.155332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08898fbd-dcb7-49dd-80f5-7cfce88402bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.168012] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.168012] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.168012] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.168012] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.168012] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.168224] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.496138] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebce5b78-ba5c-44eb-bca7-25392e0b6c55 [ 632.496533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.496533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.496698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.496799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.496887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.497091] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebce5b78-ba5c-44eb-bca7-25392e0b6c55 already deleted. [ 632.497091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebce5b78-ba5c-44eb-bca7-25392e0b6c55" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.698921] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e27d8fb6-e160-40b3-8cbd-7a6e34bda7b0 None None] Enqueued Resource ID: b8bd45cf-789a-4e2b-864a-0483978e29cd with Priority: HIGHEST for action port [ 632.699930] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bd45cf-789a-4e2b-864a-0483978e29cd with Priority: HIGHEST for action port [ 632.700672] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8bd45cf-789a-4e2b-864a-0483978e29cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.700800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8bd45cf-789a-4e2b-864a-0483978e29cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.700865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8bd45cf-789a-4e2b-864a-0483978e29cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.701160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8bd45cf-789a-4e2b-864a-0483978e29cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.701318] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8bd45cf-789a-4e2b-864a-0483978e29cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a955e9a1-23dd-4c80-89d2-f8282fa55edf req-dbcd31a6-785c-46d9-aea1-83445f3ce43d service nova] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_rules [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a955e9a1-23dd-4c80-89d2-f8282fa55edf req-dbcd31a6-785c-46d9-aea1-83445f3ce43d service nova] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a955e9a1-23dd-4c80-89d2-f8282fa55edf req-dbcd31a6-785c-46d9-aea1-83445f3ce43d service nova] Enqueued Resource ID: 43c38e03-75cf-472e-acc9-5dfcaef63c32 with Priority: HIGHEST for action port [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_rules [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 632.933024] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c38e03-75cf-472e-acc9-5dfcaef63c32 with Priority: HIGHEST for action port [ 632.933927] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.934189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.934354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.939967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.939967] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.939967] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.939967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.939967] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-43c38e03-75cf-472e-acc9-5dfcaef63c32 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.939967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.939967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.939967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.939967] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c38e03-75cf-472e-acc9-5dfcaef63c32',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.121336] env[65738]: INFO networking_nsxv3.common.synchronization [None req-1b96337e-efa4-422c-8d33-775e76fb8e75 None None] Enqueued Resource ID: c14f560b-dc3b-45d2-82c6-6b6f24320632 with Priority: HIGHEST for action port [ 633.124670] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14f560b-dc3b-45d2-82c6-6b6f24320632 with Priority: HIGHEST for action port [ 633.124670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c14f560b-dc3b-45d2-82c6-6b6f24320632 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.124670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c14f560b-dc3b-45d2-82c6-6b6f24320632" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.124670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c14f560b-dc3b-45d2-82c6-6b6f24320632" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.124670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c14f560b-dc3b-45d2-82c6-6b6f24320632" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.124670] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c14f560b-dc3b-45d2-82c6-6b6f24320632',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.204480] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8bd45cf-789a-4e2b-864a-0483978e29cd [ 633.204946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.204946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.204946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.205285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.205285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.205410] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8bd45cf-789a-4e2b-864a-0483978e29cd already deleted. [ 633.205410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8bd45cf-789a-4e2b-864a-0483978e29cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.236198] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 633.236198] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c deletion is rescheduled due to dependency. [ 633.236198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.236198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.236660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.236660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.236821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.236821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.236945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.237023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.237090] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.441579] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.441579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.447331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43c38e03-75cf-472e-acc9-5dfcaef63c32 with status ACTIVE [ 633.447573] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.447746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.447809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.448345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.448345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.448345] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.448345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.448867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.448867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.448867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.448867] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.448867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.449212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.449212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.449212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.449388] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43c38e03-75cf-472e-acc9-5dfcaef63c32 is going to be updated. [ 633.476557] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.476708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.476825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.476994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.477161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.477323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43c38e03-75cf-472e-acc9-5dfcaef63c32" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.626606] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c14f560b-dc3b-45d2-82c6-6b6f24320632 [ 633.626872] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.626981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.627064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.627286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.627404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.627505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c14f560b-dc3b-45d2-82c6-6b6f24320632 already deleted. [ 633.627591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c14f560b-dc3b-45d2-82c6-6b6f24320632" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.739550] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.242776] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.741911] env[65738]: INFO networking_nsxv3.common.synchronization [None req-37532864-61b8-4c79-87bf-1468a6a46853 None None] Enqueued Resource ID: 0ab68678-ac87-431e-a8ca-b2cf3ee25bea with Priority: HIGHEST for action port [ 634.742989] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab68678-ac87-431e-a8ca-b2cf3ee25bea with Priority: HIGHEST for action port [ 634.743167] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab68678-ac87-431e-a8ca-b2cf3ee25bea taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.744176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab68678-ac87-431e-a8ca-b2cf3ee25bea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.744176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab68678-ac87-431e-a8ca-b2cf3ee25bea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.744176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab68678-ac87-431e-a8ca-b2cf3ee25bea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.744176] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab68678-ac87-431e-a8ca-b2cf3ee25bea',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.748159] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.748159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.748159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.748159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.748159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.748159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be updated. [ 634.786845] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.786845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.786845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.786845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.786845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.800344] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 635.122089] env[65738]: INFO networking_nsxv3.common.synchronization [None req-59810897-820b-4304-88d0-42fcfdeab76f None None] Enqueued Resource ID: 624f96dd-3717-4daf-9776-5f4c70a3b99c with Priority: HIGHEST for action port [ 635.122089] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624f96dd-3717-4daf-9776-5f4c70a3b99c with Priority: HIGHEST for action port [ 635.122089] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-624f96dd-3717-4daf-9776-5f4c70a3b99c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.122744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-624f96dd-3717-4daf-9776-5f4c70a3b99c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.122995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-624f96dd-3717-4daf-9776-5f4c70a3b99c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.124152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-624f96dd-3717-4daf-9776-5f4c70a3b99c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.124152] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('624f96dd-3717-4daf-9776-5f4c70a3b99c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.247581] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ab68678-ac87-431e-a8ca-b2cf3ee25bea [ 635.248137] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.250039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.250039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.250039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.250039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.250039] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ab68678-ac87-431e-a8ca-b2cf3ee25bea already deleted. [ 635.250039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab68678-ac87-431e-a8ca-b2cf3ee25bea" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.626130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 624f96dd-3717-4daf-9776-5f4c70a3b99c [ 635.626367] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.626505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.626575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.626829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.626904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.627052] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:624f96dd-3717-4daf-9776-5f4c70a3b99c already deleted. [ 635.627172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-624f96dd-3717-4daf-9776-5f4c70a3b99c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.813088] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 636.813440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.813440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.813747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.813983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.814128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.814128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.814294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.814476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.814476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.814594] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.316948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.319296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.319296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.319296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.319296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.320325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.320325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.320325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.320325] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.823505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 907c22c5-ad71-4896-a4e9-e9855577ba3c: rpc.has_security_group_logging(os_id): False [ 637.852830] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.853980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.854106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.854307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.854412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.854665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.854786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.854864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.855058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.855142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855372] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.855482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.855544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.855709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.855783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855992] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.856176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.856218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.856358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.856446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.856535] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be updated. [ 637.904239] env[65738]: INFO networking_nsxv3.common.synchronization [None req-ba7d2252-f6e7-4a01-a161-4cac29d301fa None None] Enqueued Resource ID: ff649c80-f465-4900-82b7-3864ab8746f8 with Priority: HIGHEST for action port [ 637.904239] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff649c80-f465-4900-82b7-3864ab8746f8 with Priority: HIGHEST for action port [ 637.904695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff649c80-f465-4900-82b7-3864ab8746f8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.904695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff649c80-f465-4900-82b7-3864ab8746f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.904695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff649c80-f465-4900-82b7-3864ab8746f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.905187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff649c80-f465-4900-82b7-3864ab8746f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.905187] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff649c80-f465-4900-82b7-3864ab8746f8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.933777] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.934204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.934204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.934385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.934594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.954529] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 638.407687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff649c80-f465-4900-82b7-3864ab8746f8 [ 638.408288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.408288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.408490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.409941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.409941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.409941] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff649c80-f465-4900-82b7-3864ab8746f8 already deleted. [ 638.409941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff649c80-f465-4900-82b7-3864ab8746f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.465270] env[65738]: INFO networking_nsxv3.common.synchronization [req-366dacba-1742-412e-9317-e9668177d056 req-a176e667-e125-4225-b88c-dde9ef702029 tempest-VolumesAdminNegativeTest-1402103223 tempest-VolumesAdminNegativeTest-1402103223-project-member] Enqueued Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 638.466933] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGHEST for action security_group_members [ 638.466933] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.466933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.466933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.466933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.467325] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.467487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.467587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.467822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.468016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.468175] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.972178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.972540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.972540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.972747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.972889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.973204] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.973373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.973495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.973885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.973885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.973885] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 is going to be updated. [ 639.003067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.004584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.004584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.004584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.004584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.016806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: IN_PROGRESS for 2s [ 639.596257] env[65738]: INFO networking_nsxv3.common.synchronization [req-db02b94d-9d98-4d23-bc34-b4c73c914a2b req-7f3c05bb-c38f-476d-9368-b1c7e7f359fc tempest-SecurityGroupRulesTestJSON-236042883 tempest-SecurityGroupRulesTestJSON-236042883-project-member] Enqueued Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 639.597157] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 with Priority: HIGHEST for action security_group_rules [ 639.597454] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65a4b858-8274-4685-ac5f-65db94efa8d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.598053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.598053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.598053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.598247] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65a4b858-8274-4685-ac5f-65db94efa8d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.975496] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 639.975767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.128608] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.128608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.128608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.128608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.128608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.128608] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65a4b858-8274-4685-ac5f-65db94efa8d3 already deleted. [ 640.128608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65a4b858-8274-4685-ac5f-65db94efa8d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.030738] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 in Status: SUCCESS [ 641.031287] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 deletion is rescheduled due to dependency. [ 641.031287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.797550] env[65738]: INFO networking_nsxv3.common.synchronization [req-91a25d24-0019-4101-a130-1099b4d650e8 req-6a205a42-3bbf-4e30-a169-791f84021dab tempest-ServerDiagnosticsTest-1343836444 tempest-ServerDiagnosticsTest-1343836444-project-member] Enqueued Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 641.798172] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGHEST for action security_group_members [ 641.798493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.799593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.799820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.800047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.800233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.800883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.800999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.801340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.801467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.801589] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.141144] env[65738]: INFO networking_nsxv3.common.synchronization [req-d8ddbb5d-a5c7-464a-a8e0-66f91f71d88c req-180828aa-ecba-475f-bc66-c828a3109e34 tempest-ImagesNegativeTestJSON-1861776288 tempest-ImagesNegativeTestJSON-1861776288-project-member] Enqueued Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 642.141639] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 642.141922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.144031] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.144031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.144031] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.309217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.309217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.309217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.309217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd is going to be updated. [ 642.341757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.341965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.341965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.342388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.342388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.356245] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: IN_PROGRESS for 2s [ 642.562066] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.562290] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-261" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.562529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-261" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.563495] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-261" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.563807] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.564023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.564157] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.564378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.564844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.564844] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.564844] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.564972] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.565048] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.565161] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.565315] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.565435] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.586582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.586769] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.586874] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.587057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-261" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.587394] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-e21ddc2e-1d34-4424-b450-e49dc268e5a3 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.587601] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.587757] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.588183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.588324] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e21ddc2e-1d34-4424-b450-e49dc268e5a3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.647218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.647378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.647445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.647662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.647780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.647996] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.648146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.648280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.648391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.648469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.648555] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 already deleted. [ 642.648636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.989519] env[65738]: INFO networking_nsxv3.common.synchronization [req-29793530-02bf-42cc-a125-0dddd5cdc9c2 req-9e29e52b-c021-4df0-81c6-5e5fae7f4462 tempest-InstanceActionsV221TestJSON-1331516356 tempest-InstanceActionsV221TestJSON-1331516356-project-member] Enqueued Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 642.990154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGHEST for action security_group_members [ 642.990417] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.990521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.990622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.990832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.990990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.991250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.991365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.991448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.991532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.991625] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.091710] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.092096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.092196] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.092660] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.092837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.092998] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port e21ddc2e-1d34-4424-b450-e49dc268e5a3 not found, creating... [ 643.093292] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.093535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.093606] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.093796] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.093927] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.094226] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.094478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.094608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.094853] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.094932] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.095080] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: e21ddc2e-1d34-4424-b450-e49dc268e5a3 is going to be created. [ 643.116857] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.117097] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.117262] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.117462] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.117686] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.117901] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.494247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.494680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.494680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.494789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.495199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.495199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.495377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.495377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.495473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.495568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.495692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c is going to be updated. [ 643.524998] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.525240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.525240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.525429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.525569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.536561] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: IN_PROGRESS for 2s [ 643.549220] env[65738]: INFO networking_nsxv3.common.synchronization [req-2ea1c3f5-1c0d-4aeb-b220-290caffc23a6 req-182b4595-9e71-4bde-aec4-ff3cb6b6fd56 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 643.549220] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 643.549504] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.549673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.549780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.550030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.550224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.551039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.551039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.551039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.551039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.551039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.839717] env[65738]: INFO networking_nsxv3.common.synchronization [req-d8ddbb5d-a5c7-464a-a8e0-66f91f71d88c req-97f1030e-d5d2-4670-9f3c-cd3c54cc2316 service nova] Enqueued Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_rules [ 643.839924] env[65738]: INFO networking_nsxv3.common.synchronization [req-d8ddbb5d-a5c7-464a-a8e0-66f91f71d88c req-97f1030e-d5d2-4670-9f3c-cd3c54cc2316 service nova] Enqueued Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 643.840053] env[65738]: INFO networking_nsxv3.common.synchronization [req-d8ddbb5d-a5c7-464a-a8e0-66f91f71d88c req-97f1030e-d5d2-4670-9f3c-cd3c54cc2316 service nova] Enqueued Resource ID: e21ddc2e-1d34-4424-b450-e49dc268e5a3 with Priority: HIGHEST for action port [ 643.840519] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_rules [ 643.840980] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 643.841113] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21ddc2e-1d34-4424-b450-e49dc268e5a3 with Priority: HIGHEST for action port [ 643.841429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.841550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.841672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.841878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.841963] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.843261] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.843370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.843456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.843611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.843852] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.843998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.844097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.844190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.844277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.844567] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.845575] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e21ddc2e-1d34-4424-b450-e49dc268e5a3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.845575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.845575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.845575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.845575] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e21ddc2e-1d34-4424-b450-e49dc268e5a3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.053065] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.053388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.055060] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.055060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.055060] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 644.100189] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.100189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.100189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.100497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.100497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.113377] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 644.343998] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.344282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.347826] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e21ddc2e-1d34-4424-b450-e49dc268e5a3 with status ACTIVE [ 644.349223] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.349441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.349639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.349919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.350298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.350523] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.350762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.350920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.351305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.351413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.351637] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.351809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.351956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.352670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.352670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.352670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e21ddc2e-1d34-4424-b450-e49dc268e5a3 is going to be updated. [ 644.354211] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.369296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beba0424-1a8e-44c6-90d2-7d725d4330cd in Status: SUCCESS [ 644.369659] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd deletion is rescheduled due to dependency. [ 644.369797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.381142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.381359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.381437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.381679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.381832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.381999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e21ddc2e-1d34-4424-b450-e49dc268e5a3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.406752] env[65738]: INFO networking_nsxv3.common.synchronization [req-b7d0f352-5ba4-4fbd-9268-043c0ee20f53 req-ee97749f-03fc-4380-9aa0-8154fb8d7faa tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 644.407434] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 644.407863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.408703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.408811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.409121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.409356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.409507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.409608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.409845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.409975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.410209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.701307] env[65738]: INFO networking_nsxv3.common.synchronization [req-8305249d-a384-45b9-840c-bc46a8a47afe req-6faa1aa8-8680-4c62-a77a-3238588fa986 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 644.702034] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 644.702158] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.702301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.702371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.702630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.702782] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.702879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.702936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.704500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.704500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.704500] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.861130] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.913847] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.960709] env[65738]: INFO networking_nsxv3.common.synchronization [req-b7d0f352-5ba4-4fbd-9268-043c0ee20f53 req-c0322d49-7c00-4403-9200-96a4cc98627f tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 644.961453] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 644.961762] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.961865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.205747] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.205967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.206144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.206623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.206723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.206923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.207040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.207148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.207264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.207340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.207424] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb already deleted. [ 645.207510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.292172] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.292393] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.292480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.292806] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.293183] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.293301] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.293834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.294132] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.294207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.294618] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.294618] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.294618] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.294770] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.295597] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.295597] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.295597] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.314512] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.314713] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.314801] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.315666] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.315666] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-deb9fe32-88e7-499b-bece-6672e6e4b3ec taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.315666] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.315666] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.315998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.316139] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb9fe32-88e7-499b-bece-6672e6e4b3ec',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.363286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.363436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.363511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.363720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.363810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.363936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 is going to be created. [ 645.388925] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.389084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.389180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.389471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.389642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.400374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: UNINITIALIZED for 2s [ 645.416209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.504095] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9a001027-3e05-4792-9ea0-28fc69a60c9c None None] Enqueued Resource ID: 10a4cc3b-7271-4a50-a816-07b2265b893c with Priority: HIGHEST for action port [ 645.504637] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a4cc3b-7271-4a50-a816-07b2265b893c with Priority: HIGHEST for action port [ 645.505010] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-10a4cc3b-7271-4a50-a816-07b2265b893c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.505155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10a4cc3b-7271-4a50-a816-07b2265b893c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.505155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10a4cc3b-7271-4a50-a816-07b2265b893c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.505670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10a4cc3b-7271-4a50-a816-07b2265b893c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.505670] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a4cc3b-7271-4a50-a816-07b2265b893c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.548511] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c in Status: SUCCESS [ 645.548814] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c deletion is rescheduled due to dependency. [ 645.548945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.666908] env[65738]: INFO networking_nsxv3.common.synchronization [req-b7d0f352-5ba4-4fbd-9268-043c0ee20f53 req-4c50abcb-60bc-499a-b129-b3a3c91b7f37 tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 645.667900] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 645.668248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.668371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.822303] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.822303] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port deb9fe32-88e7-499b-bece-6672e6e4b3ec not found, creating... [ 645.822303] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.822303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.822967] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.822967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.822967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.822967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.822967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.822967] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: deb9fe32-88e7-499b-bece-6672e6e4b3ec is going to be created. [ 645.857466] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.857466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.857466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.857466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.857466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.857466] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.919254] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.919452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.920031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.920031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.920031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.920031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 645.958803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.959054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.959145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.959448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.959645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.975133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 646.009133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10a4cc3b-7271-4a50-a816-07b2265b893c [ 646.009133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.009133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.009133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.009133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.009133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.009133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10a4cc3b-7271-4a50-a816-07b2265b893c already deleted. [ 646.009133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10a4cc3b-7271-4a50-a816-07b2265b893c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.125049] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 646.125049] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 646.125049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.628548] env[65738]: INFO networking_nsxv3.common.synchronization [req-8305249d-a384-45b9-840c-bc46a8a47afe req-08ef8a14-831f-4b8d-b071-a50a1806b583 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 646.628724] env[65738]: INFO networking_nsxv3.common.synchronization [req-8305249d-a384-45b9-840c-bc46a8a47afe req-08ef8a14-831f-4b8d-b071-a50a1806b583 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 646.628854] env[65738]: INFO networking_nsxv3.common.synchronization [req-8305249d-a384-45b9-840c-bc46a8a47afe req-08ef8a14-831f-4b8d-b071-a50a1806b583 service nova] Enqueued Resource ID: deb9fe32-88e7-499b-bece-6672e6e4b3ec with Priority: HIGHEST for action port [ 646.629417] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 646.629580] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 646.629680] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb9fe32-88e7-499b-bece-6672e6e4b3ec with Priority: HIGHEST for action port [ 646.632449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.632591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.632660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.632933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.633031] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.633984] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.634096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.634172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.634960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.634960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.634960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.634960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.634960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.634960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.635403] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.636995] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-deb9fe32-88e7-499b-bece-6672e6e4b3ec taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.636995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.636995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.638295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.638369] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb9fe32-88e7-499b-bece-6672e6e4b3ec',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.141530] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.144352] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.144560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.145718] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port deb9fe32-88e7-499b-bece-6672e6e4b3ec with status ACTIVE [ 647.145941] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.146311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.146622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.146881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.146996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.147208] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.147361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.147428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.147693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.147781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.148037] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.148167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.148568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.148791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.148904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.149031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: deb9fe32-88e7-499b-bece-6672e6e4b3ec is going to be updated. [ 647.173392] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.173505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.173505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.173705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.173852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.174021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deb9fe32-88e7-499b-bece-6672e6e4b3ec" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.411873] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: SUCCESS [ 647.412168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.413063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.413063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.413063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.413063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.413063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.413322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.413322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.413322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.413427] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.647416] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.811636] env[65738]: INFO networking_nsxv3.common.synchronization [None req-4dafd313-9b85-4c3f-b5bb-6c07c2feeb44 None None] Enqueued Resource ID: d88b7c9a-568d-4585-a052-5e1cc455aa98 with Priority: HIGHEST for action port [ 647.812493] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88b7c9a-568d-4585-a052-5e1cc455aa98 with Priority: HIGHEST for action port [ 647.813170] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d88b7c9a-568d-4585-a052-5e1cc455aa98 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.813170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d88b7c9a-568d-4585-a052-5e1cc455aa98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.813170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d88b7c9a-568d-4585-a052-5e1cc455aa98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.815760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d88b7c9a-568d-4585-a052-5e1cc455aa98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.815932] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d88b7c9a-568d-4585-a052-5e1cc455aa98',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.915987] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.916205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.916205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.916517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.916898] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.917065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.917138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.917324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.917617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.917617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.917760] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.917935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.918291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.918445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.918545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.918793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.918865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.918915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.919096] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.984957] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 647.985207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.985386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.985610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.985804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.985916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.985976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.986147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.986220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.986321] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.152303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.152728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.152728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.152840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.152916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.152966] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 648.193221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.193351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.193402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.193742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.193827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.207773] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: UNINITIALIZED for 2s [ 648.321839] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d88b7c9a-568d-4585-a052-5e1cc455aa98 [ 648.322295] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.322295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.322413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.322551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.322639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.322734] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d88b7c9a-568d-4585-a052-5e1cc455aa98 already deleted. [ 648.322811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d88b7c9a-568d-4585-a052-5e1cc455aa98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.422056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2: rpc.has_security_group_logging(os_id): False [ 648.442025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.442355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.442355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.442652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.442743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.442928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.443040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.443107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.443268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.443341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.443565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.443794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.443794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.443904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.443945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.444871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.446234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.446234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.446588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.446832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446963] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 is going to be created. [ 648.488574] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.488792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.488837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.489080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.489174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.489384] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.489540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.489593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.489762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.489876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.489936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 648.538639] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.538876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.538876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.539877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.539877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.552441] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.552672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.552729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.552982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.553275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.555195] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 648.580658] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: IN_PROGRESS for 2s [ 649.480723] env[65738]: INFO networking_nsxv3.common.synchronization [req-6602096f-4de7-42b4-977b-0cb3c464ae1c req-ae60d3d1-653c-4477-b309-2a09093ab8a1 tempest-ServersNegativeTestMultiTenantJSON-1989745605 tempest-ServersNegativeTestMultiTenantJSON-1989745605-project-member] Enqueued Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 649.481426] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 649.482077] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.482077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.482077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.482443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.482611] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.482716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.482782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.482938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.483036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.483131] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.929175] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.929672] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-746" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.929857] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-746" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.930232] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-746" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.930590] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.930905] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.931082] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.931393] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.931609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.931862] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.932029] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.932144] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.932250] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.932354] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.932454] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.932590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.953808] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.954080] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.954290] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.954543] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-746" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.954909] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.955203] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.955411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.955768] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.955977] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('524ecba9-5b4d-4d98-965b-ed47c70fb0bd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.986785] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.986785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.986785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.987044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.987252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.987360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.987462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.987462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.987581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.987634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.987745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e already deleted. [ 649.987849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.217885] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 650.217885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.217885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.217885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.218176] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.218176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.218385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.218385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.218516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.218516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.218630] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.458752] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.458987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.459120] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.459399] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.459539] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.459689] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 524ecba9-5b4d-4d98-965b-ed47c70fb0bd not found, creating... [ 650.459958] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.460130] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.460240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.460623] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.460759] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.461050] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.461201] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.461347] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.461555] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.461680] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.461812] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 524ecba9-5b4d-4d98-965b-ed47c70fb0bd is going to be created. [ 650.571786] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 650.573349] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 deletion is rescheduled due to dependency. [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.573349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.573349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.573349] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.576182] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.576437] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.576880] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.576880] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.576987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.577349] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.593447] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: SUCCESS [ 650.593818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.721425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.721629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.721729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.721959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.722141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.722243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.722296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.722448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.722538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.722625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.722808] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.722880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.722939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.723096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.723232] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.723323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.723382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.723518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.723593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.723671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.723760] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.082270] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.082270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.082270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.082270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.082270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.082659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.082659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.082659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.082786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.082885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.083540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 651.118119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.118320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.118320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.118550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.119168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.132348] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 651.222622] env[65738]: INFO networking_nsxv3.common.synchronization [req-6602096f-4de7-42b4-977b-0cb3c464ae1c req-e9703e58-c0dd-43b7-86fe-7f3c08cc6d38 service nova] Enqueued Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_rules [ 651.222854] env[65738]: INFO networking_nsxv3.common.synchronization [req-6602096f-4de7-42b4-977b-0cb3c464ae1c req-e9703e58-c0dd-43b7-86fe-7f3c08cc6d38 service nova] Enqueued Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 651.223044] env[65738]: INFO networking_nsxv3.common.synchronization [req-6602096f-4de7-42b4-977b-0cb3c464ae1c req-e9703e58-c0dd-43b7-86fe-7f3c08cc6d38 service nova] Enqueued Resource ID: 524ecba9-5b4d-4d98-965b-ed47c70fb0bd with Priority: HIGHEST for action port [ 651.223638] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_rules [ 651.223822] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 651.223894] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 524ecba9-5b4d-4d98-965b-ed47c70fb0bd with Priority: HIGHEST for action port [ 651.224319] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.224319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.224562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.224977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.224977] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.226055] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.226197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.226255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.226530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.226590] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.226694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.226756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.226905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.226988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.227093] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.228174] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.228174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.228174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.228325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.228325] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('524ecba9-5b4d-4d98-965b-ed47c70fb0bd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.229859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 651.262381] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.262381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.262381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.263222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.263222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.263222] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.263222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.263452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.263529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.263654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.263860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.263994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.264097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.265067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.265067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.265067] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 651.345735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.345979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.345979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.346312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.346417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.368239] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 651.729885] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.730312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.730312] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.735634] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 524ecba9-5b4d-4d98-965b-ed47c70fb0bd with status ACTIVE [ 651.735634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.735634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.735911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.735911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.735993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.736187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.736291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.736333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.736495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.736564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.736744] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.736835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.736896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.737063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.737133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.737176] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 524ecba9-5b4d-4d98-965b-ed47c70fb0bd is going to be updated. [ 651.761091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.761091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.761355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.761448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.761588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.761754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-524ecba9-5b4d-4d98-965b-ed47c70fb0bd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.888044] env[65738]: INFO networking_nsxv3.common.synchronization [req-cdafd4ef-33cc-4733-94cd-8d6a3f021ea6 req-208ab64d-3569-4c56-8d29-614699475aa3 tempest-TenantUsagesTestJSON-1792522266 tempest-TenantUsagesTestJSON-1792522266-project-member] Enqueued Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 651.888468] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 651.888564] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.888635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.888744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.888949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.889147] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.889313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.889408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.889598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.889684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.889784] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.232966] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.375401] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375614] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375735] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.376058] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376655] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.376823] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376935] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.377198] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.377313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.377527] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.377635] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.377745] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.377849] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.377952] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.378065] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.378195] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.392105] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.392340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.392340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.392585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.392636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.392798] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.392910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.392964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.393126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.393211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.393517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 already deleted. [ 652.393517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.398330] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.398493] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.398625] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.398789] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.399110] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-693a21cf-691b-4b0b-85e1-020b8f0d7c82 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.399311] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.399434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.399739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.399871] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('693a21cf-691b-4b0b-85e1-020b8f0d7c82',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.735264] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.735620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.735620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.735941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.735941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.735941] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e is going to be created. [ 652.764731] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.764882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.764957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.765190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.765420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.779462] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: UNINITIALIZED for 2s [ 652.902578] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.903271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.903271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.903271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.903516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.903703] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 693a21cf-691b-4b0b-85e1-020b8f0d7c82 not found, creating... [ 652.903970] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.904146] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.904258] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904489] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904616] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.904890] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.905329] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.905539] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.906071] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.906071] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.906240] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 693a21cf-691b-4b0b-85e1-020b8f0d7c82 is going to be created. [ 652.928822] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.929199] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.929380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.929763] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.930084] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.930418] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.143222] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 653.143632] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 deletion is rescheduled due to dependency. [ 653.143769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.381979] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 653.381979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.662929] env[65738]: INFO networking_nsxv3.common.synchronization [req-cdafd4ef-33cc-4733-94cd-8d6a3f021ea6 req-5f1d62d6-b998-4eec-a0ee-5992c12b245a service nova] Enqueued Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_rules [ 653.662929] env[65738]: INFO networking_nsxv3.common.synchronization [req-cdafd4ef-33cc-4733-94cd-8d6a3f021ea6 req-5f1d62d6-b998-4eec-a0ee-5992c12b245a service nova] Enqueued Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 653.662929] env[65738]: INFO networking_nsxv3.common.synchronization [req-cdafd4ef-33cc-4733-94cd-8d6a3f021ea6 req-5f1d62d6-b998-4eec-a0ee-5992c12b245a service nova] Enqueued Resource ID: 693a21cf-691b-4b0b-85e1-020b8f0d7c82 with Priority: HIGHEST for action port [ 653.663497] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_rules [ 653.663663] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 653.663766] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 693a21cf-691b-4b0b-85e1-020b8f0d7c82 with Priority: HIGHEST for action port [ 653.664071] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.664183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.664292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.664519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.664629] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.665575] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.665684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.665778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.665941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.666116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.666246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.666320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.666475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.666562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.666682] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.667505] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-693a21cf-691b-4b0b-85e1-020b8f0d7c82 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.667644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.667708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.667833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.667883] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('693a21cf-691b-4b0b-85e1-020b8f0d7c82',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.245789] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.245789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.245789] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 693a21cf-691b-4b0b-85e1-020b8f0d7c82 with status ACTIVE [ 654.245789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.245789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.245789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.247292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.247292] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 693a21cf-691b-4b0b-85e1-020b8f0d7c82 is going to be updated. [ 654.247292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.247292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-693a21cf-691b-4b0b-85e1-020b8f0d7c82" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.673602] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.789203] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: SUCCESS [ 654.789455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.789655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.789899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.790113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.790229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.790372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.790513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.790513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.790644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.790701] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.177738] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.177738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.177738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.178038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.178156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.178285] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 is going to be created. [ 655.204977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.205144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.205226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.205435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.205619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.216959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: UNINITIALIZED for 2s [ 655.295596] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.295596] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.295596] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.295596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.296299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.296299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.296510] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.801706] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e: rpc.has_security_group_logging(os_id): False [ 655.823202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.823664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.823664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.823664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.823990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.823990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.824221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.824221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.824515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.824515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.824515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.824989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.824989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.824989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.824989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.825164] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.825164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.825318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.825318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.825414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.826031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e is going to be created. [ 655.892955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.892955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.892955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.892955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.894901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.906790] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: IN_PROGRESS for 2s [ 655.908718] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5ef63324-b50b-41a9-9e4f-4ac168d78c3d None None] Enqueued Resource ID: 05d7a673-a227-4b83-841a-a7e9c85355fa with Priority: HIGHEST for action port [ 655.908972] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d7a673-a227-4b83-841a-a7e9c85355fa with Priority: HIGHEST for action port [ 655.909858] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d7a673-a227-4b83-841a-a7e9c85355fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.909858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d7a673-a227-4b83-841a-a7e9c85355fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.909858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d7a673-a227-4b83-841a-a7e9c85355fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.910022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d7a673-a227-4b83-841a-a7e9c85355fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.910149] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d7a673-a227-4b83-841a-a7e9c85355fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.414283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05d7a673-a227-4b83-841a-a7e9c85355fa [ 656.414283] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.414283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.414283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.414283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.414283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.414283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05d7a673-a227-4b83-841a-a7e9c85355fa already deleted. [ 656.414283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d7a673-a227-4b83-841a-a7e9c85355fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.229324] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: SUCCESS [ 657.229861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.229861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.230052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.230216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.230292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.230292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.230462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.230539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.231256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.231256] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.734350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.734752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.734752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.734872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.735483] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.735483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.735483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.735483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.735483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735881] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.735881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.735881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.735881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.736062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.736111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.736174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.736312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.736374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.737030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.737030] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.922334] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: SUCCESS [ 657.925503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.243572] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adec5b77-f6bd-4b0d-8254-ba4bb52f63e3: rpc.has_security_group_logging(os_id): False [ 658.265147] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.265329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.265382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.265651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.265724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.265928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.266088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.266148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.266271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.266346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.266530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.266639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.266682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.266815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.266888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.267769] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.268310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.268310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.268310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.268480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.268480] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 is going to be created. [ 658.397262] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.397455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.397455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.397730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.397818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.412655] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: IN_PROGRESS for 2s [ 658.728735] env[65738]: INFO networking_nsxv3.common.synchronization [None req-cdfd821f-9b22-46a5-b67e-28640a96b9da None None] Enqueued Resource ID: d6efdd80-68bc-4193-8c04-64d411426a8e with Priority: HIGHEST for action port [ 658.728991] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6efdd80-68bc-4193-8c04-64d411426a8e with Priority: HIGHEST for action port [ 658.729290] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6efdd80-68bc-4193-8c04-64d411426a8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.729433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6efdd80-68bc-4193-8c04-64d411426a8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.729750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6efdd80-68bc-4193-8c04-64d411426a8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.729750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6efdd80-68bc-4193-8c04-64d411426a8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.729871] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6efdd80-68bc-4193-8c04-64d411426a8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.234370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6efdd80-68bc-4193-8c04-64d411426a8e [ 659.234370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.234370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.234370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.234370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.234370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.234370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6efdd80-68bc-4193-8c04-64d411426a8e already deleted. [ 659.234370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6efdd80-68bc-4193-8c04-64d411426a8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.841532] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e02ef884-7a4d-4dc6-bd8c-88c80ab5d42d None None] Enqueued Resource ID: 02502f03-f6e5-4b14-b8a9-fe47cc868228 with Priority: HIGHEST for action port [ 659.842482] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02502f03-f6e5-4b14-b8a9-fe47cc868228 with Priority: HIGHEST for action port [ 659.842482] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-02502f03-f6e5-4b14-b8a9-fe47cc868228 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.842830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02502f03-f6e5-4b14-b8a9-fe47cc868228" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.842830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02502f03-f6e5-4b14-b8a9-fe47cc868228" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.843820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02502f03-f6e5-4b14-b8a9-fe47cc868228" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.843820] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02502f03-f6e5-4b14-b8a9-fe47cc868228',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.346183] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02502f03-f6e5-4b14-b8a9-fe47cc868228 [ 660.346183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.346183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.346183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.346760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.346760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.346760] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02502f03-f6e5-4b14-b8a9-fe47cc868228 already deleted. [ 660.347731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02502f03-f6e5-4b14-b8a9-fe47cc868228" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.428868] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: SUCCESS [ 660.428996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.533565] env[65738]: INFO networking_nsxv3.common.synchronization [None req-03b9d7ec-7252-4c83-a0eb-dd5b097ceab5 None None] Enqueued Resource ID: d19f89cb-3229-4b01-9c00-37092231ad7f with Priority: HIGHEST for action port [ 660.534563] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19f89cb-3229-4b01-9c00-37092231ad7f with Priority: HIGHEST for action port [ 660.534563] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d19f89cb-3229-4b01-9c00-37092231ad7f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.534763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d19f89cb-3229-4b01-9c00-37092231ad7f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.534763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d19f89cb-3229-4b01-9c00-37092231ad7f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.536341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d19f89cb-3229-4b01-9c00-37092231ad7f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.536445] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d19f89cb-3229-4b01-9c00-37092231ad7f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.038664] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d19f89cb-3229-4b01-9c00-37092231ad7f [ 661.040107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.040107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.040107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.040107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.040107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.040107] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d19f89cb-3229-4b01-9c00-37092231ad7f already deleted. [ 661.040107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d19f89cb-3229-4b01-9c00-37092231ad7f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.102466] env[65738]: INFO networking_nsxv3.common.synchronization [req-66f0f9b3-a716-4c08-b210-e97e716f43f2 req-050ffd6a-93f9-4c7b-b729-d722c3cb376d tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 662.105930] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 662.106330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.106499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.106499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.107030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.107030] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.107030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.107323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.107323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.107323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.107572] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.373579] env[65738]: INFO networking_nsxv3.common.synchronization [None req-ca198d35-21dc-49ef-a150-ec6bfe556c92 None None] Enqueued Resource ID: c73bfdf9-2b50-4113-9348-48c1bb39c7bc with Priority: HIGHEST for action port [ 662.375239] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c73bfdf9-2b50-4113-9348-48c1bb39c7bc with Priority: HIGHEST for action port [ 662.376663] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c73bfdf9-2b50-4113-9348-48c1bb39c7bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.376663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c73bfdf9-2b50-4113-9348-48c1bb39c7bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.376663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c73bfdf9-2b50-4113-9348-48c1bb39c7bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.376663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c73bfdf9-2b50-4113-9348-48c1bb39c7bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.376663] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c73bfdf9-2b50-4113-9348-48c1bb39c7bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.610786] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.611046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.611046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.612075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.612228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.613724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.613724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.613724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.613724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.613724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.613724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 662.644479] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.644825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.644825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.648060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.648060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.657692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 662.837227] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.837227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.837227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.837227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.841030] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.841030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.841030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.841030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.841030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.841030] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.841030] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.841030] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.841030] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.841030] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.841030] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.841030] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.861791] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.861948] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.862312] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.862312] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.862718] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-b9b3bd68-f614-4157-a2cf-39151918e551 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.862804] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.862934] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.863294] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.863432] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b3bd68-f614-4157-a2cf-39151918e551',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.880841] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c73bfdf9-2b50-4113-9348-48c1bb39c7bc [ 662.881077] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.881237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.881302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.881513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.881605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.881708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c73bfdf9-2b50-4113-9348-48c1bb39c7bc already deleted. [ 662.881788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c73bfdf9-2b50-4113-9348-48c1bb39c7bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.007320] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3620c477-c8fc-4292-a9ac-3a90d80de6c7 None None] Enqueued Resource ID: 179bdd90-e3a7-46ac-a9bc-07e52dd9aee1 with Priority: HIGHEST for action port [ 663.007320] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179bdd90-e3a7-46ac-a9bc-07e52dd9aee1 with Priority: HIGHEST for action port [ 663.007320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-179bdd90-e3a7-46ac-a9bc-07e52dd9aee1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.007320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179bdd90-e3a7-46ac-a9bc-07e52dd9aee1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.007320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179bdd90-e3a7-46ac-a9bc-07e52dd9aee1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.007320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179bdd90-e3a7-46ac-a9bc-07e52dd9aee1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.007320] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179bdd90-e3a7-46ac-a9bc-07e52dd9aee1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.313637] env[65738]: INFO networking_nsxv3.common.synchronization [req-b43f6c10-d9ec-4faa-aeec-eb158bbfb95e req-61a8ca74-cd0b-4986-a171-7fdd753578d8 tempest-DeleteServersAdminTestJSON-2077497370 tempest-DeleteServersAdminTestJSON-2077497370-project-member] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 663.315200] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGHEST for action security_group_members [ 663.315200] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.315200] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.315200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.315627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.315627] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.366505] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.366730] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.366844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.367143] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.367286] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.367449] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port b9b3bd68-f614-4157-a2cf-39151918e551 not found, creating... [ 663.367733] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.367888] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.368019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.369389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.369389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.369389] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.369389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.369389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.369389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.369673] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.369924] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: b9b3bd68-f614-4157-a2cf-39151918e551 is going to be created. [ 663.393787] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.393787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.393787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.393787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.393787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.394116] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.507729] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 179bdd90-e3a7-46ac-a9bc-07e52dd9aee1 [ 663.507969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.508136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.508200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.508405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.508499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.508612] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:179bdd90-e3a7-46ac-a9bc-07e52dd9aee1 already deleted. [ 663.508674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179bdd90-e3a7-46ac-a9bc-07e52dd9aee1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.818284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.818507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.818567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.818757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.818837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.819050] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.819151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.819225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.819370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.819466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.819552] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be updated. [ 663.859647] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.859647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.859647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.859647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.859647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.870371] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: IN_PROGRESS for 2s [ 664.013241] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d1487652-5e9c-4418-938b-f656c9e0d0cd None None] Enqueued Resource ID: e9a4f806-d64e-4ce0-bb65-3620c433d4cb with Priority: HIGHEST for action port [ 664.013241] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9a4f806-d64e-4ce0-bb65-3620c433d4cb with Priority: HIGHEST for action port [ 664.013241] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9a4f806-d64e-4ce0-bb65-3620c433d4cb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.013241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9a4f806-d64e-4ce0-bb65-3620c433d4cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.013789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9a4f806-d64e-4ce0-bb65-3620c433d4cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.014417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9a4f806-d64e-4ce0-bb65-3620c433d4cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.014591] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9a4f806-d64e-4ce0-bb65-3620c433d4cb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.232329] env[65738]: INFO networking_nsxv3.common.synchronization [req-66f0f9b3-a716-4c08-b210-e97e716f43f2 req-d43968df-6a3f-4684-a5bb-19c18c924175 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 664.232503] env[65738]: INFO networking_nsxv3.common.synchronization [req-66f0f9b3-a716-4c08-b210-e97e716f43f2 req-d43968df-6a3f-4684-a5bb-19c18c924175 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 664.232631] env[65738]: INFO networking_nsxv3.common.synchronization [req-66f0f9b3-a716-4c08-b210-e97e716f43f2 req-d43968df-6a3f-4684-a5bb-19c18c924175 service nova] Enqueued Resource ID: b9b3bd68-f614-4157-a2cf-39151918e551 with Priority: HIGHEST for action port [ 664.235552] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 664.235783] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 664.235849] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b3bd68-f614-4157-a2cf-39151918e551 with Priority: HIGHEST for action port [ 664.236125] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.236280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.236365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.236512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.237332] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.237808] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.237922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.238109] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b3bd68-f614-4157-a2cf-39151918e551 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.238209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.238269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.238444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.238525] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b3bd68-f614-4157-a2cf-39151918e551',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.341776] env[65738]: INFO networking_nsxv3.common.synchronization [req-50a0d221-deb0-4e63-a0c5-de3c5fc81e33 req-465899fd-9f4b-45fe-ab95-f74394c8055d tempest-FloatingIPsAssociationNegativeTestJSON-1659273675 tempest-FloatingIPsAssociationNegativeTestJSON-1659273675-project-member] Enqueued Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 664.342476] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGHEST for action security_group_members [ 664.343350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.343350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.343350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.343350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.343870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.344015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.344091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.344260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.344378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.344474] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.518955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9a4f806-d64e-4ce0-bb65-3620c433d4cb [ 664.519969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.520917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.520917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.520917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.520917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.520917] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9a4f806-d64e-4ce0-bb65-3620c433d4cb already deleted. [ 664.520917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9a4f806-d64e-4ce0-bb65-3620c433d4cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.673691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 664.673840] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 664.674032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.674373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.674429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.674699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.674699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.674975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.674975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.675244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.675244] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.740684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.740779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.744016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9b3bd68-f614-4157-a2cf-39151918e551 with status ACTIVE [ 664.744016] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.744016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.744016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.744016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.744483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.744483] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.744483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.744632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.744999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.744999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.744999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.745176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.745176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.745331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.745380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.745498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9b3bd68-f614-4157-a2cf-39151918e551 is going to be updated. [ 664.769511] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.769511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.769511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.769511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.769511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.769511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b3bd68-f614-4157-a2cf-39151918e551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.848477] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.848655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.848728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.848945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.849073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.849287] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.849452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.849452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.849622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.849702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.849847] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf78d499-f745-40ce-9541-deee900c2003 is going to be updated. [ 664.887020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.887020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.887020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.887020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.887020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.902660] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: IN_PROGRESS for 2s [ 665.177431] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.651758] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6ffb0a7a-c3ec-4502-b96a-a1781ed4b192 None None] Enqueued Resource ID: bd805226-e54a-4647-a087-be56ff3f26b2 with Priority: HIGHEST for action port [ 665.653380] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd805226-e54a-4647-a087-be56ff3f26b2 with Priority: HIGHEST for action port [ 665.653380] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd805226-e54a-4647-a087-be56ff3f26b2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.653380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd805226-e54a-4647-a087-be56ff3f26b2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.653380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd805226-e54a-4647-a087-be56ff3f26b2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.653795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd805226-e54a-4647-a087-be56ff3f26b2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.653795] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd805226-e54a-4647-a087-be56ff3f26b2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.682886] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.893124] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c in Status: SUCCESS [ 665.893124] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c deletion is rescheduled due to dependency. [ 665.893124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.159422] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd805226-e54a-4647-a087-be56ff3f26b2 [ 666.159869] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.160038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.160110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.160333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.160537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.160537] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd805226-e54a-4647-a087-be56ff3f26b2 already deleted. [ 666.161302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd805226-e54a-4647-a087-be56ff3f26b2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.185938] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.186118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.186250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.186532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.186718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.187180] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 666.223494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.223594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.223639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.223843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.224015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.235360] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 666.620791] env[65738]: INFO networking_nsxv3.common.synchronization [req-09942cf3-5a9f-4461-b672-28e4d3af13dd req-8e0a95aa-195f-40f9-870c-cce201b39fbd tempest-ImagesNegativeTestJSON-1861776288 tempest-ImagesNegativeTestJSON-1861776288-project-member] Enqueued Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 666.621211] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGHEST for action security_group_members [ 666.621742] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.621911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.622127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.622380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.622713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.622856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.622978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.623264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.623404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.623574] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.915209] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf78d499-f745-40ce-9541-deee900c2003 in Status: SUCCESS [ 666.915421] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf78d499-f745-40ce-9541-deee900c2003 deletion is rescheduled due to dependency. [ 666.915514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.126707] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.126707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.126707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.127515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.127515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.127515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.127515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.127515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.127864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.127864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.127864] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 is going to be updated. [ 667.167583] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.167583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.167583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.167583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.167583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.183437] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: IN_PROGRESS for 2s [ 667.397777] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e55465d4-ba7a-4cb0-8304-15b86bb98b03 None None] Enqueued Resource ID: 741cd21f-b5fb-4ff5-ba2b-e61c25639d02 with Priority: HIGHEST for action port [ 667.397777] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741cd21f-b5fb-4ff5-ba2b-e61c25639d02 with Priority: HIGHEST for action port [ 667.397777] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-741cd21f-b5fb-4ff5-ba2b-e61c25639d02 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.397777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-741cd21f-b5fb-4ff5-ba2b-e61c25639d02" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.397777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-741cd21f-b5fb-4ff5-ba2b-e61c25639d02" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.397777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-741cd21f-b5fb-4ff5-ba2b-e61c25639d02" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.397777] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('741cd21f-b5fb-4ff5-ba2b-e61c25639d02',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.901579] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 741cd21f-b5fb-4ff5-ba2b-e61c25639d02 [ 667.901922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.902091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.902217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.902524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.902939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.902939] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:741cd21f-b5fb-4ff5-ba2b-e61c25639d02 already deleted. [ 667.902939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-741cd21f-b5fb-4ff5-ba2b-e61c25639d02" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.246273] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 4s [ 669.195648] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 in Status: SUCCESS [ 669.195982] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 deletion is rescheduled due to dependency. [ 669.196113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.677041] env[65738]: INFO networking_nsxv3.common.synchronization [req-9dc14a25-828b-488a-ae13-72794a35a5ec req-d627caa0-29e6-4a24-be7c-3b6aa5036eaf tempest-ServerRescueTestJSON-1769012266 tempest-ServerRescueTestJSON-1769012266-project-member] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 669.678242] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 669.678569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.678698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.678769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.679047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.679320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.679387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.679436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.679646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.679699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.680146] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.103575] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0d660d6a-5bd1-4922-b8c1-0d54081e8e1d None None] Enqueued Resource ID: d05c67f1-1b30-4fa3-b625-8a2493f62a74 with Priority: HIGHEST for action port [ 670.104293] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d05c67f1-1b30-4fa3-b625-8a2493f62a74 with Priority: HIGHEST for action port [ 670.104727] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d05c67f1-1b30-4fa3-b625-8a2493f62a74 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.104916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d05c67f1-1b30-4fa3-b625-8a2493f62a74" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.105477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d05c67f1-1b30-4fa3-b625-8a2493f62a74" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.105477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d05c67f1-1b30-4fa3-b625-8a2493f62a74" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.105477] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05c67f1-1b30-4fa3-b625-8a2493f62a74',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.163362] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b7848f43-8da9-4aa0-8d87-f6cee84656a2 None None] Enqueued Resource ID: c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c with Priority: HIGHEST for action port [ 670.163947] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c with Priority: HIGHEST for action port [ 670.164264] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.164391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.164445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.164699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.164901] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.179040] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.179304] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.179718] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.180076] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.180389] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.180945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.181113] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.181371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.181611] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.182119] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.182809] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.182961] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.183114] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.183252] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.183380] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.183534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.186119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.186119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.186119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.186617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.186748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.186975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.187119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.187204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.187380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.187495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.187601] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 already deleted. [ 670.187702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.208151] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.208396] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.208456] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.208698] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.208947] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-1944742f-267d-4468-ad6a-b45b4defc4ef taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.209131] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.209246] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.209625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.209762] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1944742f-267d-4468-ad6a-b45b4defc4ef',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.260870] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 670.260870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.260870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.261167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.261347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.261414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.261621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.261707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.261743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.261828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.261915] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.607870] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d05c67f1-1b30-4fa3-b625-8a2493f62a74 [ 670.608149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.608416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.608486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.608735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.609056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.609254] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d05c67f1-1b30-4fa3-b625-8a2493f62a74 already deleted. [ 670.609254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d05c67f1-1b30-4fa3-b625-8a2493f62a74" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.667306] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c [ 670.667374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.667501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.667597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.667863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.668046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.668130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c already deleted. [ 670.668218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a8e8b1-bd57-4797-ad1c-9b96c668ee5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.712836] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.713309] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.713376] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.713755] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.713986] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.714212] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 1944742f-267d-4468-ad6a-b45b4defc4ef not found, creating... [ 670.714625] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.714788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.714922] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.715230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.715355] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.715701] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.715918] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.716076] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.716336] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.716530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.716687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 1944742f-267d-4468-ad6a-b45b4defc4ef is going to be created. [ 670.754745] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.755015] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.755125] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.755410] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.755648] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.755864] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.765768] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.765768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.765768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.765768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.766299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.766299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.766299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.766299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.766489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.766489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.766572] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.766734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.766925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.767101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.767261] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.767363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.767426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.767614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.767702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.767786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.767874] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.189041] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a913968-729e-4977-b081-4824fc0c9e54 req-99944b1d-7324-4504-b660-e5a2cd73e510 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 671.189602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 671.189937] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.190256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.190338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.190775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.190775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.190924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.190924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.190994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.191099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.191197] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.269687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1: rpc.has_security_group_logging(os_id): False [ 671.297364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.297364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.297364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.297364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.298340] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.298340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.298340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.298340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.298340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.298340] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 671.374040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.374216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.374216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.374397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.374541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.388642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 671.461384] env[65738]: INFO networking_nsxv3.common.synchronization [req-9dc14a25-828b-488a-ae13-72794a35a5ec req-4b81204e-3490-4969-8850-8264682c784d service nova] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_rules [ 671.461644] env[65738]: INFO networking_nsxv3.common.synchronization [req-9dc14a25-828b-488a-ae13-72794a35a5ec req-4b81204e-3490-4969-8850-8264682c784d service nova] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 671.461786] env[65738]: INFO networking_nsxv3.common.synchronization [req-9dc14a25-828b-488a-ae13-72794a35a5ec req-4b81204e-3490-4969-8850-8264682c784d service nova] Enqueued Resource ID: 1944742f-267d-4468-ad6a-b45b4defc4ef with Priority: HIGHEST for action port [ 671.462705] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_rules [ 671.462866] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 671.462924] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1944742f-267d-4468-ad6a-b45b4defc4ef with Priority: HIGHEST for action port [ 671.463225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.463354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.463504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.463807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.463875] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.464806] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.464917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.464987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.465780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.465780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.465780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.465780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.465780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.465780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.465780] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.466866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1944742f-267d-4468-ad6a-b45b4defc4ef taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.466866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.466866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.467039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.467083] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1944742f-267d-4468-ad6a-b45b4defc4ef',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.707239] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.707420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.707469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.708063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.708063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.708063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.708260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.708260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.708346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.708554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.708554] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 671.754432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.754432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.754432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.754862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.754862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.766305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 671.969618] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.970888] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.971591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.972717] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1944742f-267d-4468-ad6a-b45b4defc4ef with status ACTIVE [ 671.972717] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.972832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.973693] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.973693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.974501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.974501] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.974501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.974501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.974501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.974501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.974501] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1944742f-267d-4468-ad6a-b45b4defc4ef is going to be updated. [ 671.998727] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.998874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.999010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.999252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.999293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.999431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1944742f-267d-4468-ad6a-b45b4defc4ef" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.472494] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.944539] env[65738]: INFO networking_nsxv3.common.synchronization [req-f91416a1-56ae-43fc-ae30-ed8ee2ce9f53 req-a0997e22-b2b3-4e0e-ae88-ae8d0da929fa tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 672.945076] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 672.945381] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.945882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.946282] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.946406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.946470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.946647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.946737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.946890] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.975316] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.975522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.975522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.975757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.976058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.976058] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be created. [ 673.006246] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.006457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.006457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.006663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.006833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.027705] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: UNINITIALIZED for 2s [ 673.128193] env[65738]: INFO networking_nsxv3.common.synchronization [None req-683bfc79-60b3-4f06-9c80-291664eada27 None None] Enqueued Resource ID: 9becd8a1-547b-4b04-93d1-b382918c5428 with Priority: HIGHEST for action port [ 673.128193] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9becd8a1-547b-4b04-93d1-b382918c5428 with Priority: HIGHEST for action port [ 673.128193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9becd8a1-547b-4b04-93d1-b382918c5428 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.128193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9becd8a1-547b-4b04-93d1-b382918c5428" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.128193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9becd8a1-547b-4b04-93d1-b382918c5428" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.128749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9becd8a1-547b-4b04-93d1-b382918c5428" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.128934] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9becd8a1-547b-4b04-93d1-b382918c5428',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.352199] env[65738]: INFO networking_nsxv3.common.synchronization [None req-f28e1cd0-e811-4dc2-b362-189317e63f99 None None] Enqueued Resource ID: 52dd1ce7-9968-4896-b2da-c522dd0bf2d9 with Priority: HIGHEST for action port [ 673.352199] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52dd1ce7-9968-4896-b2da-c522dd0bf2d9 with Priority: HIGHEST for action port [ 673.352199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-52dd1ce7-9968-4896-b2da-c522dd0bf2d9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.352199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52dd1ce7-9968-4896-b2da-c522dd0bf2d9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.352199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52dd1ce7-9968-4896-b2da-c522dd0bf2d9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.352199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52dd1ce7-9968-4896-b2da-c522dd0bf2d9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.352199] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52dd1ce7-9968-4896-b2da-c522dd0bf2d9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.403916] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 673.404263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.450269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.450496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.450496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.451233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.451342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.452319] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.452319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.452319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.452744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.452744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.452819] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 already deleted. [ 673.452872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.630813] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9becd8a1-547b-4b04-93d1-b382918c5428 [ 673.631053] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.631183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.631252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.631510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.631623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.631716] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9becd8a1-547b-4b04-93d1-b382918c5428 already deleted. [ 673.631798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9becd8a1-547b-4b04-93d1-b382918c5428" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.777480] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 673.778134] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 673.778134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.856088] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52dd1ce7-9968-4896-b2da-c522dd0bf2d9 [ 673.856198] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.856269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.856602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.856602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.856737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.856737] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52dd1ce7-9968-4896-b2da-c522dd0bf2d9 already deleted. [ 673.856842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52dd1ce7-9968-4896-b2da-c522dd0bf2d9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.119511] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.119871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.119871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.120167] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.120420] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.121841] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.121991] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.122240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.122383] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.122621] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.122734] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.122839] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.122939] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.123061] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.123161] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.123287] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.145178] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.145344] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.146108] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.146108] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.146108] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-49f95d05-16d0-4922-abb1-301eef075e9d taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.146291] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.146291] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.146565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.146694] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f95d05-16d0-4922-abb1-301eef075e9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.352540] env[65738]: INFO networking_nsxv3.common.synchronization [None req-963fba04-0b71-4ea3-a8a8-cb3dd6fb9200 None None] Enqueued Resource ID: 5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5 with Priority: HIGHEST for action port [ 674.353274] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5 with Priority: HIGHEST for action port [ 674.353596] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.353716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.353782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.354099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.354351] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.653548] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.653861] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.653987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.654790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.654790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.654790] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 49f95d05-16d0-4922-abb1-301eef075e9d not found, creating... [ 674.654968] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.654968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.655090] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.656032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.656032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.656355] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.656580] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.656753] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.657012] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.657190] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.657362] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 49f95d05-16d0-4922-abb1-301eef075e9d is going to be created. [ 674.689039] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.689039] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.689039] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.689039] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.689367] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.689367] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.856989] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5 [ 674.857316] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.857456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.857520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.857724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.857934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.857934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5 already deleted. [ 674.858079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5291d584-4f6e-4f4a-b5ed-00c9beb2a6e5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.038447] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 675.038671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.038846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.039549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.039549] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.039780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.039780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.039907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.039986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.040083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.040172] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.372988] env[65738]: INFO networking_nsxv3.common.synchronization [req-f91416a1-56ae-43fc-ae30-ed8ee2ce9f53 req-2a662ea0-044d-4f4e-ad83-441c73229274 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 675.373275] env[65738]: INFO networking_nsxv3.common.synchronization [req-f91416a1-56ae-43fc-ae30-ed8ee2ce9f53 req-2a662ea0-044d-4f4e-ad83-441c73229274 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 675.373275] env[65738]: INFO networking_nsxv3.common.synchronization [req-f91416a1-56ae-43fc-ae30-ed8ee2ce9f53 req-2a662ea0-044d-4f4e-ad83-441c73229274 service nova] Enqueued Resource ID: 49f95d05-16d0-4922-abb1-301eef075e9d with Priority: HIGHEST for action port [ 675.373839] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 675.373936] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 675.374069] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f95d05-16d0-4922-abb1-301eef075e9d with Priority: HIGHEST for action port [ 675.374306] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.374565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.374565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.374758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.374807] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.376841] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.376841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.376841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.378694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.378694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.378694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.378694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.378694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.378694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.378694] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.378694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-49f95d05-16d0-4922-abb1-301eef075e9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.379568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.379568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.379568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.379568] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f95d05-16d0-4922-abb1-301eef075e9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.542825] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.543203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.543203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.543326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.543518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.543618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.543776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.545020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.545020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.545020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.547571] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.547722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.547830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.547961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.548134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.548312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.548312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.548432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.548522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.548780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.548780] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.885150] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.885150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.885150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49f95d05-16d0-4922-abb1-301eef075e9d with status ACTIVE [ 675.885150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.885150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.885150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.885775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.885775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.885775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.886562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.889029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.889029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49f95d05-16d0-4922-abb1-301eef075e9d is going to be updated. [ 675.910667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.910770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.910770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.910972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.911622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.912020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49f95d05-16d0-4922-abb1-301eef075e9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.051323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33ab54d8-f174-4187-9e64-2cd39cd90273: rpc.has_security_group_logging(os_id): False [ 676.070322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.070498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.070549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.070733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.070821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.071169] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.071169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.071317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.071358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.071416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.071723] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.071813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.071922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.071989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.072151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.072239] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.072316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.072386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.072740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.072740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.072898] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be created. [ 676.132803] env[65738]: INFO networking_nsxv3.common.synchronization [None req-af1bbd9c-7749-40c5-a1a6-187062fe121b None None] Enqueued Resource ID: 64ac79b1-625a-4255-bfc5-a26c06ac8ff2 with Priority: HIGHEST for action port [ 676.133381] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ac79b1-625a-4255-bfc5-a26c06ac8ff2 with Priority: HIGHEST for action port [ 676.133694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-64ac79b1-625a-4255-bfc5-a26c06ac8ff2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.133819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64ac79b1-625a-4255-bfc5-a26c06ac8ff2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.133884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64ac79b1-625a-4255-bfc5-a26c06ac8ff2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.135288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64ac79b1-625a-4255-bfc5-a26c06ac8ff2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.135381] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64ac79b1-625a-4255-bfc5-a26c06ac8ff2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.146250] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.146250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.146250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.146250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.146250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.158107] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 676.392394] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.638721] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64ac79b1-625a-4255-bfc5-a26c06ac8ff2 [ 676.638981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.639164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.639323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.639637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.639637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.639913] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64ac79b1-625a-4255-bfc5-a26c06ac8ff2 already deleted. [ 676.639913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64ac79b1-625a-4255-bfc5-a26c06ac8ff2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.894806] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.894806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.894806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.894806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.894806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.894806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be created. [ 676.917556] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.917757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.917757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.917962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.918159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.930885] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: UNINITIALIZED for 2s [ 677.554844] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9d15d162-08d2-4369-adc4-197403ced68f tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a with Priority: HIGHEST for action security_group_rules [ 677.555541] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a with Priority: HIGHEST for action security_group_rules [ 677.555688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.555810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.555903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.556173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.556256] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26dd2b8c-ccfd-43d3-8c14-414f9860f31a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.853425] env[65738]: INFO networking_nsxv3.common.synchronization [None req-768bbdb1-9a6f-4f4c-9474-ae03713ef3c7 None None] Enqueued Resource ID: 59cc518c-056b-45f1-b33f-ab6375bf957b with Priority: HIGHEST for action port [ 677.853874] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59cc518c-056b-45f1-b33f-ab6375bf957b with Priority: HIGHEST for action port [ 677.854145] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-59cc518c-056b-45f1-b33f-ab6375bf957b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.854316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59cc518c-056b-45f1-b33f-ab6375bf957b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.854316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59cc518c-056b-45f1-b33f-ab6375bf957b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.854623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59cc518c-056b-45f1-b33f-ab6375bf957b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.854757] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59cc518c-056b-45f1-b33f-ab6375bf957b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.916820] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c05fbef9-1b23-43c1-9e2b-72e783cbe3d7 tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a with Priority: HIGHEST for action security_group_rules [ 677.917982] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a with Priority: HIGHEST for action security_group_rules [ 677.917982] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.917982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.080874] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.081120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.081120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.081330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.081420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.081525] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a already deleted. [ 678.081619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.081775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.081938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.082034] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26dd2b8c-ccfd-43d3-8c14-414f9860f31a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.171310] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 678.171602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359067] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59cc518c-056b-45f1-b33f-ab6375bf957b [ 678.359067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.359067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.359067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.359067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.359067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359067] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59cc518c-056b-45f1-b33f-ab6375bf957b already deleted. [ 678.359067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59cc518c-056b-45f1-b33f-ab6375bf957b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.606233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.606233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.606233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.606748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.606748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.606748] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26dd2b8c-ccfd-43d3-8c14-414f9860f31a already deleted. [ 678.606748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26dd2b8c-ccfd-43d3-8c14-414f9860f31a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.942798] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.944034] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.944034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.944436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.944436] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.447199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.447427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.447513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.447754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.447940] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.448059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.448138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.448305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.448388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.448476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.448626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.448719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.448774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.448916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.449066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.449155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.449207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.449343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.449435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.449512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.449632] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.951845] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 679.970689] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.970856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.970926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.971155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.971928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.971928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.971928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.971928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.971928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.971928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.972468] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.972468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.972468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.972468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.972669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.973512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.973512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.973512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.973512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.973512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.973512] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be created. [ 680.038464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.038783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.038938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.039152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.039453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.053335] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 680.553159] env[65738]: INFO networking_nsxv3.common.synchronization [None req-dd53c716-d98f-4d15-aa8b-9df177b11c65 None None] Enqueued Resource ID: 7882d4c8-d469-4c7a-b2e1-96365961f38f with Priority: HIGHEST for action port [ 680.553912] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7882d4c8-d469-4c7a-b2e1-96365961f38f with Priority: HIGHEST for action port [ 680.555404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7882d4c8-d469-4c7a-b2e1-96365961f38f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.555549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7882d4c8-d469-4c7a-b2e1-96365961f38f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.555623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7882d4c8-d469-4c7a-b2e1-96365961f38f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.555902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7882d4c8-d469-4c7a-b2e1-96365961f38f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.555987] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7882d4c8-d469-4c7a-b2e1-96365961f38f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.059971] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7882d4c8-d469-4c7a-b2e1-96365961f38f [ 681.060333] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.060425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.060461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.060697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.060863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.060975] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7882d4c8-d469-4c7a-b2e1-96365961f38f already deleted. [ 681.061109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7882d4c8-d469-4c7a-b2e1-96365961f38f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.969026] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6c8c67fc-a735-4b89-b8a2-a04bdf1b3438 None None] Enqueued Resource ID: b09dd56e-083b-4a85-8616-8efc4acd71fb with Priority: HIGHEST for action port [ 681.969026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09dd56e-083b-4a85-8616-8efc4acd71fb with Priority: HIGHEST for action port [ 681.969026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09dd56e-083b-4a85-8616-8efc4acd71fb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.969026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09dd56e-083b-4a85-8616-8efc4acd71fb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.969026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09dd56e-083b-4a85-8616-8efc4acd71fb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.969026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09dd56e-083b-4a85-8616-8efc4acd71fb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.969026] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09dd56e-083b-4a85-8616-8efc4acd71fb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.067201] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 682.067201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.472442] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b09dd56e-083b-4a85-8616-8efc4acd71fb [ 682.475117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.475117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.475117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.475117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.475117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.475117] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b09dd56e-083b-4a85-8616-8efc4acd71fb already deleted. [ 682.475117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09dd56e-083b-4a85-8616-8efc4acd71fb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008461] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c4ab6b9f-f2bc-4d89-9d1b-81399425acac None None] Enqueued Resource ID: e379d494-6c4f-41d0-b0b4-32af33ad780a with Priority: HIGHEST for action port [ 683.008923] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e379d494-6c4f-41d0-b0b4-32af33ad780a with Priority: HIGHEST for action port [ 683.009356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e379d494-6c4f-41d0-b0b4-32af33ad780a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.009481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e379d494-6c4f-41d0-b0b4-32af33ad780a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.009533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e379d494-6c4f-41d0-b0b4-32af33ad780a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.009807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e379d494-6c4f-41d0-b0b4-32af33ad780a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.009888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e379d494-6c4f-41d0-b0b4-32af33ad780a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.513254] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e379d494-6c4f-41d0-b0b4-32af33ad780a [ 683.513570] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.513666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.513911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.514342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.514342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.514342] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e379d494-6c4f-41d0-b0b4-32af33ad780a already deleted. [ 683.514342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e379d494-6c4f-41d0-b0b4-32af33ad780a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.081765] env[65738]: INFO networking_nsxv3.common.synchronization [req-8b5f1797-ff7d-40ac-ab2a-caec3e85a7fa req-17cadb20-2da3-40e1-8f98-a8a6adf5f3ac tempest-ServerMetadataTestJSON-118508465 tempest-ServerMetadataTestJSON-118508465-project-member] Enqueued Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 684.086096] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 684.086096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.088120] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.088120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.088120] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.319562] env[65738]: INFO networking_nsxv3.common.synchronization [None req-2d5cf903-98de-40c5-9044-cd93c52560c7 None None] Enqueued Resource ID: ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7 with Priority: HIGHEST for action port [ 684.320215] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7 with Priority: HIGHEST for action port [ 684.320547] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.320687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.320791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.321050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.321131] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.514679] env[65738]: INFO networking_nsxv3.common.synchronization [None req-2e23f2d2-54ae-4d3d-b4e6-f446c9c03627 None None] Enqueued Resource ID: 41a62170-26af-43ed-8f60-ec6a59dfb232 with Priority: HIGHEST for action port [ 684.515937] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41a62170-26af-43ed-8f60-ec6a59dfb232 with Priority: HIGHEST for action port [ 684.516432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-41a62170-26af-43ed-8f60-ec6a59dfb232 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.516626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41a62170-26af-43ed-8f60-ec6a59dfb232" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41a62170-26af-43ed-8f60-ec6a59dfb232" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41a62170-26af-43ed-8f60-ec6a59dfb232" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517474] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41a62170-26af-43ed-8f60-ec6a59dfb232',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.532567] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-448 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.532808] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-448" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.532942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-448" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.533338] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-448" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.534813] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.536893] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.537115] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.537464] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.537671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.537923] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.538096] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.538226] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.538347] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.538495] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.538617] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.538790] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.563984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.564414] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.564718] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.565050] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-448" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.566453] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-cea4f7d3-795d-4745-860a-2bd669c7c7c0 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.566453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.566453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.566453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.566453] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cea4f7d3-795d-4745-860a-2bd669c7c7c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.593599] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.594228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.594228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.594228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.594228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.594619] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.594619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.594619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.595238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.595238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.595238] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f already deleted. [ 684.595238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.823695] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7 [ 684.823967] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.824201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.824201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.824414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.824511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.824606] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7 already deleted. [ 684.824687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed5deb1e-df65-4bfb-9eb8-2904f8eb71f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.020564] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41a62170-26af-43ed-8f60-ec6a59dfb232 [ 685.020813] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.020950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.021269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.021269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.021360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.021459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41a62170-26af-43ed-8f60-ec6a59dfb232 already deleted. [ 685.021545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41a62170-26af-43ed-8f60-ec6a59dfb232" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.070290] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.070644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.070793] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.071140] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.071315] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.071524] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port cea4f7d3-795d-4745-860a-2bd669c7c7c0 not found, creating... [ 685.071815] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.072112] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.072181] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.072411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.072715] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.072889] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.073105] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.073312] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.073535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.074240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.074240] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: cea4f7d3-795d-4745-860a-2bd669c7c7c0 is going to be created. [ 685.095509] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.097028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.097028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.097028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.097028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.097028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.848105] env[65738]: INFO networking_nsxv3.common.synchronization [req-8b5f1797-ff7d-40ac-ab2a-caec3e85a7fa req-f0bdb44e-7b6a-41d2-997a-f9007a104858 service nova] Enqueued Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_rules [ 685.848362] env[65738]: INFO networking_nsxv3.common.synchronization [req-8b5f1797-ff7d-40ac-ab2a-caec3e85a7fa req-f0bdb44e-7b6a-41d2-997a-f9007a104858 service nova] Enqueued Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 685.848436] env[65738]: INFO networking_nsxv3.common.synchronization [req-8b5f1797-ff7d-40ac-ab2a-caec3e85a7fa req-f0bdb44e-7b6a-41d2-997a-f9007a104858 service nova] Enqueued Resource ID: cea4f7d3-795d-4745-860a-2bd669c7c7c0 with Priority: HIGHEST for action port [ 685.848982] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_rules [ 685.849392] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 685.849392] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea4f7d3-795d-4745-860a-2bd669c7c7c0 with Priority: HIGHEST for action port [ 685.849807] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.850191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.850347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.850734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.850811] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.852480] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.852635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.852707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.852888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.853545] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.853545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.853545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.853643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.853768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.853924] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.854754] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-cea4f7d3-795d-4745-860a-2bd669c7c7c0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.854926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.855040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.856110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.856241] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cea4f7d3-795d-4745-860a-2bd669c7c7c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.954687] env[65738]: INFO networking_nsxv3.common.synchronization [None req-dbbecca6-d644-4a54-be7a-9d074e5e6202 None None] Enqueued Resource ID: ca6f49f9-ef51-4c94-b27f-64e695eb8950 with Priority: HIGHEST for action port [ 685.955163] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca6f49f9-ef51-4c94-b27f-64e695eb8950 with Priority: HIGHEST for action port [ 685.955494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca6f49f9-ef51-4c94-b27f-64e695eb8950 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.955637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca6f49f9-ef51-4c94-b27f-64e695eb8950" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.955706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca6f49f9-ef51-4c94-b27f-64e695eb8950" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.955969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca6f49f9-ef51-4c94-b27f-64e695eb8950" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.956444] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca6f49f9-ef51-4c94-b27f-64e695eb8950',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.237841] env[65738]: INFO networking_nsxv3.common.synchronization [None req-00121ec9-f9b8-466a-8879-d04599f59935 tempest-ServersTestFqdnHostnames-505815451 tempest-ServersTestFqdnHostnames-505815451-project-member] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 686.238272] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 686.238569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.238691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.241055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.241386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.241499] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.363491] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.363491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.363491] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cea4f7d3-795d-4745-860a-2bd669c7c7c0 with status ACTIVE [ 686.363491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.363491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.363491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.364035] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.364035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.364035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.364035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.364035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.364035] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cea4f7d3-795d-4745-860a-2bd669c7c7c0 is going to be updated. [ 686.391276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.391276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.391276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.391276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.391276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.391276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cea4f7d3-795d-4745-860a-2bd669c7c7c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.460081] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca6f49f9-ef51-4c94-b27f-64e695eb8950 [ 686.460864] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.460864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.460864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.460864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.460864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.461037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca6f49f9-ef51-4c94-b27f-64e695eb8950 already deleted. [ 686.461037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca6f49f9-ef51-4c94-b27f-64e695eb8950" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.494111] env[65738]: INFO networking_nsxv3.common.synchronization [None req-14c8fbcf-621d-4680-9316-891d389d7ee9 tempest-ServersTestFqdnHostnames-505815451 tempest-ServersTestFqdnHostnames-505815451-project-member] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 686.494674] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 686.495062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.495439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.768361] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.768361] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 already deleted. [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.768361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.768361] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.867019] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.989157] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3fd02796-5ae6-41c8-911d-41d8156b1991 None None] Enqueued Resource ID: d2a8e2f8-9983-44c7-ac4c-d27b9925ab49 with Priority: HIGHEST for action port [ 686.990493] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2a8e2f8-9983-44c7-ac4c-d27b9925ab49 with Priority: HIGHEST for action port [ 686.990493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2a8e2f8-9983-44c7-ac4c-d27b9925ab49 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.990493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2a8e2f8-9983-44c7-ac4c-d27b9925ab49" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.990493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2a8e2f8-9983-44c7-ac4c-d27b9925ab49" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.990493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2a8e2f8-9983-44c7-ac4c-d27b9925ab49" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.990493] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2a8e2f8-9983-44c7-ac4c-d27b9925ab49',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.289362] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.289752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.289752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.289828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.289876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.290113] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 already deleted. [ 687.290113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.374523] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.374523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.374523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.375327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.375327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.375327] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f is going to be created. [ 687.403533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.404249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.404249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.404249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.404249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.416787] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: UNINITIALIZED for 2s [ 687.494188] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2a8e2f8-9983-44c7-ac4c-d27b9925ab49 [ 687.494488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.495226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.495226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.495226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.495226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.495226] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2a8e2f8-9983-44c7-ac4c-d27b9925ab49 already deleted. [ 687.495226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2a8e2f8-9983-44c7-ac4c-d27b9925ab49" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.350023] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-d2dcce9f-d4ee-451b-9e00-64871cc221b2 tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 688.350785] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 688.351269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.351379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.351429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.351742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.351925] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.352185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.352185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.352288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.352385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.352489] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.801180] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c47f6ee2-4722-4060-94af-a21c065f748b None None] Enqueued Resource ID: 751b7ebe-844d-4ab7-b59e-e622e43eb3d3 with Priority: HIGHEST for action port [ 688.803036] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751b7ebe-844d-4ab7-b59e-e622e43eb3d3 with Priority: HIGHEST for action port [ 688.803036] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-751b7ebe-844d-4ab7-b59e-e622e43eb3d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.803036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-751b7ebe-844d-4ab7-b59e-e622e43eb3d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.803036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-751b7ebe-844d-4ab7-b59e-e622e43eb3d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.803036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-751b7ebe-844d-4ab7-b59e-e622e43eb3d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.803036] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751b7ebe-844d-4ab7-b59e-e622e43eb3d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.856275] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.856418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.856456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.856656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.856745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.857989] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.857989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.857989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.859124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.859688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.859688] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 688.892357] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-0e720752-7975-4db0-8fbb-33a7f6496dad tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 688.892357] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 688.892470] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.892538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.898511] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.898511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.898511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.898511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.898511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.909152] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 689.307716] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 751b7ebe-844d-4ab7-b59e-e622e43eb3d3 [ 689.307716] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.307830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.307982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.308156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.308254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.308354] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:751b7ebe-844d-4ab7-b59e-e622e43eb3d3 already deleted. [ 689.308433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-751b7ebe-844d-4ab7-b59e-e622e43eb3d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.428806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: SUCCESS [ 689.429192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.429229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.429425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.429765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.430053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.430053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.430171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.430225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.430325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.430415] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.522331] env[65738]: INFO networking_nsxv3.common.synchronization [req-7c1cdbe4-eeba-4f72-9f69-b87f85eda6de req-ac129659-71a8-4596-95c2-1aae884ec154 tempest-TenantUsagesTestJSON-1792522266 tempest-TenantUsagesTestJSON-1792522266-project-member] Enqueued Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 689.523062] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGHEST for action security_group_members [ 689.524527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.524704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.524815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.525081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.525295] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.525454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.525557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.525760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.525887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.526040] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.528056] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.528230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.528350] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.528629] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.528874] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.529039] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.529152] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.529366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.529504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.529704] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.529817] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.529920] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.530036] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.530140] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.530243] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.530367] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.552223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.552399] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.552522] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.552713] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.553035] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b6f7340d-60c7-4325-aa38-1b02c32af5b9 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.553201] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.554729] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.554997] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.555151] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f7340d-60c7-4325-aa38-1b02c32af5b9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.935800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.936783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.936875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.937268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.937489] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.937612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.937682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.937868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.937961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.938063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.938221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.938314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.938373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.938536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.938681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.938775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.938834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.938969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.939056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.939134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.939221] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.033039] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.033197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.033197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.033338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.033432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.033623] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.033768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.033768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.033950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.033977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.034151] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 is going to be updated. [ 690.057981] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.058146] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.058146] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.059168] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.059168] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.059168] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b6f7340d-60c7-4325-aa38-1b02c32af5b9 not found, creating... [ 690.059168] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.059168] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.059522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.059522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.059578] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.059854] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.060009] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.060164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.060362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.060493] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.060628] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b6f7340d-60c7-4325-aa38-1b02c32af5b9 is going to be created. [ 690.064994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.065123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.065194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.065377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.065633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.076146] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: IN_PROGRESS for 2s [ 690.082106] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.082549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.082549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.082709] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.082937] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.083167] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.442958] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5655ef30-50fd-430d-8d49-08277c5e5c9f: rpc.has_security_group_logging(os_id): False [ 690.461724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.461931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.462027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.462252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.462342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.462565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.462689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.462763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.462969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.463063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.463320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.463471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.463564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.463770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.463935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.464246] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.464407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.464518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.464744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.464876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.464980] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f is going to be created. [ 690.529016] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.529016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.529016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.529351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.529351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.541510] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: IN_PROGRESS for 2s [ 690.825757] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-c209ab96-4580-4872-afa9-ecb58dce5be4 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 690.825932] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-c209ab96-4580-4872-afa9-ecb58dce5be4 service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 690.826078] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-c209ab96-4580-4872-afa9-ecb58dce5be4 service nova] Enqueued Resource ID: b6f7340d-60c7-4325-aa38-1b02c32af5b9 with Priority: HIGHEST for action port [ 690.826317] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 690.826441] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 690.826549] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f7340d-60c7-4325-aa38-1b02c32af5b9 with Priority: HIGHEST for action port [ 690.827333] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.827464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.827567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.827754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.828000] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.833073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.833073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.833073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f7340d-60c7-4325-aa38-1b02c32af5b9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.833073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.833290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.833290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.833499] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f7340d-60c7-4325-aa38-1b02c32af5b9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.918984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 690.919190] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 deletion is rescheduled due to dependency. [ 690.919424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.919603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.919863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.920109] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.920260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.920331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.920495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.920578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.920695] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.333973] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.333973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.340091] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6f7340d-60c7-4325-aa38-1b02c32af5b9 with status ACTIVE [ 691.340091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.340091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.340091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.340091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.340091] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6f7340d-60c7-4325-aa38-1b02c32af5b9 is going to be updated. [ 691.364392] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.364653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.364759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.364976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.365138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.365307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f7340d-60c7-4325-aa38-1b02c32af5b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.423186] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.538018] env[65738]: INFO networking_nsxv3.common.synchronization [None req-1797af73-8cc8-4a07-a447-cc41c515d059 None None] Enqueued Resource ID: 4ff50774-ba8e-4317-9f4f-095bad0c18a2 with Priority: HIGHEST for action port [ 691.538018] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff50774-ba8e-4317-9f4f-095bad0c18a2 with Priority: HIGHEST for action port [ 691.538490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff50774-ba8e-4317-9f4f-095bad0c18a2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.538624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff50774-ba8e-4317-9f4f-095bad0c18a2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.538689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff50774-ba8e-4317-9f4f-095bad0c18a2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.538960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff50774-ba8e-4317-9f4f-095bad0c18a2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.540808] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff50774-ba8e-4317-9f4f-095bad0c18a2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.678057] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.678057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-398" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.678057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-398" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.678258] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-398" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.678633] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.678633] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.678811] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.678966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.679109] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.679293] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.679401] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.679551] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.679647] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.679737] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.679854] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.679966] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.705205] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.706602] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.706769] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.706955] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-398" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.707306] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-afe0fd08-d458-4da5-ac7a-58e822abb72b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.707815] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.708207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.709121] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.709854] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afe0fd08-d458-4da5-ac7a-58e822abb72b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.926078] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.029014] env[65738]: INFO networking_nsxv3.common.synchronization [req-b1bf78cc-9dc8-4b93-b60f-b16262eeef07 req-e40a7529-9707-42c6-877a-3b3da62a34c3 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 692.029554] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 692.029932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.030376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.030459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.030712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.030879] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.030981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.031055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.031205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.031292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.031388] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.042305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff50774-ba8e-4317-9f4f-095bad0c18a2 [ 692.042634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.042634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.042717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.043587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.043587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.043587] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff50774-ba8e-4317-9f4f-095bad0c18a2 already deleted. [ 692.043587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff50774-ba8e-4317-9f4f-095bad0c18a2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.086124] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 in Status: SUCCESS [ 692.086434] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 deletion is rescheduled due to dependency. [ 692.086627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.217721] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.217968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.218217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.218682] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.219267] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.219478] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port afe0fd08-d458-4da5-ac7a-58e822abb72b not found, creating... [ 692.220058] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.220648] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.220887] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.221214] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.221394] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.222492] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.223976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.223976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.223976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.223976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.223976] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: afe0fd08-d458-4da5-ac7a-58e822abb72b is going to be created. [ 692.245099] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.245338] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.245458] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.245738] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.246086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.246281] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.429170] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.429418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.429516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.429768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.429890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.431022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 692.464687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.467441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.467441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.467903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.468114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.482016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 692.534767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.534767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.534767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.535200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.535200] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b already deleted. [ 692.535200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.555552] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: SUCCESS [ 692.555951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.594806] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.595103] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.595280] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.595654] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.596728] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.597070] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.597265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.597541] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.597697] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.598247] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.598247] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.598247] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.598363] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.598467] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.598628] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.598715] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.625410] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.625590] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.625789] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.625880] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.626222] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.626386] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.626501] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.626845] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.626996] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('376e6dd8-16cb-4271-824c-44a7cc4e6a5c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.067757] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-e1252ece-4864-4092-a08f-9d931d802e1f service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 693.068006] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-e1252ece-4864-4092-a08f-9d931d802e1f service nova] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 693.068154] env[65738]: INFO networking_nsxv3.common.synchronization [req-66e30c94-feca-4240-85f3-53456fcbce04 req-e1252ece-4864-4092-a08f-9d931d802e1f service nova] Enqueued Resource ID: afe0fd08-d458-4da5-ac7a-58e822abb72b with Priority: HIGHEST for action port [ 693.068884] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_rules [ 693.069257] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 693.069466] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe0fd08-d458-4da5-ac7a-58e822abb72b with Priority: HIGHEST for action port [ 693.070000] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.070737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.074375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-afe0fd08-d458-4da5-ac7a-58e822abb72b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.074375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.074375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.074375] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afe0fd08-d458-4da5-ac7a-58e822abb72b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.129091] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.129478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.129650] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.129953] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.130172] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.130333] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 376e6dd8-16cb-4271-824c-44a7cc4e6a5c not found, creating... [ 693.130656] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.130834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.130963] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.131259] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.131397] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.131686] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.131860] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.131976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.132337] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.132337] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.132487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 376e6dd8-16cb-4271-824c-44a7cc4e6a5c is going to be created. [ 693.155599] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.155827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.155977] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.156274] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.156511] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.156764] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.417386] env[65738]: INFO networking_nsxv3.common.synchronization [None req-ba8beb50-d85e-44c3-9df8-2606d71783bc tempest-ServersTestBootFromVolume-696029730 tempest-ServersTestBootFromVolume-696029730-project-member] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 693.417386] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 693.417386] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.417386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.417386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.417747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.417747] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.577037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afe0fd08-d458-4da5-ac7a-58e822abb72b with status ACTIVE [ 693.577037] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.577037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.577037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.577037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.577037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.577037] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.577037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.577962] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.577962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.578198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.578198] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afe0fd08-d458-4da5-ac7a-58e822abb72b is going to be updated. [ 693.601518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.601824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.601824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.602020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.602173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.602366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afe0fd08-d458-4da5-ac7a-58e822abb72b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.794581] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5474c12d-4a7d-4aa3-9f28-04bace297e45 tempest-ServersTestBootFromVolume-696029730 tempest-ServersTestBootFromVolume-696029730-project-member] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 693.795103] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 693.795926] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.796418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.941934] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.941934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 already deleted. [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.941934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.941934] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.950449] env[65738]: INFO networking_nsxv3.common.synchronization [req-b1bf78cc-9dc8-4b93-b60f-b16262eeef07 req-71bb6336-0f7e-407c-b611-1b56129eb473 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 693.950835] env[65738]: INFO networking_nsxv3.common.synchronization [req-b1bf78cc-9dc8-4b93-b60f-b16262eeef07 req-71bb6336-0f7e-407c-b611-1b56129eb473 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 693.951252] env[65738]: INFO networking_nsxv3.common.synchronization [req-b1bf78cc-9dc8-4b93-b60f-b16262eeef07 req-71bb6336-0f7e-407c-b611-1b56129eb473 service nova] Enqueued Resource ID: 376e6dd8-16cb-4271-824c-44a7cc4e6a5c with Priority: HIGHEST for action port [ 693.952049] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 693.952294] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 693.952749] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376e6dd8-16cb-4271-824c-44a7cc4e6a5c with Priority: HIGHEST for action port [ 693.953550] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.953906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.954375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954891] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.955929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.956768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.956768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.956768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.956768] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.957610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.957610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.957755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.957805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.957865] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.960667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.961418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.961953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.961953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.961953] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('376e6dd8-16cb-4271-824c-44a7cc4e6a5c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.362359] env[65738]: INFO networking_nsxv3.common.synchronization [req-af6058df-33b8-48cd-b659-2eb74c2af76e req-5ccf5e37-20a8-480c-91c9-c079323d1776 tempest-ServersNegativeTestMultiTenantJSON-1989745605 tempest-ServersNegativeTestMultiTenantJSON-1989745605-project-member] Enqueued Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 694.362553] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGHEST for action security_group_members [ 694.363168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.363303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.363390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.363598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.363788] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.363900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.364010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.364187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.364301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.364407] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.463592] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.465123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.465306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.465832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 376e6dd8-16cb-4271-824c-44a7cc4e6a5c with status ACTIVE [ 694.466129] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.466296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.466395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.466741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.466817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.468427] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.468624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.468728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.471329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.471496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.471824] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.471992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.472106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.472355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.472475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.472611] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 376e6dd8-16cb-4271-824c-44a7cc4e6a5c is going to be updated. [ 694.478071] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.478228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.478496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.478496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.478567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.478638] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 already deleted. [ 694.478731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.496621] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 694.496852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.497043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.497256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.497443] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.497558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.497622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.497770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.497850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.497946] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.516656] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.516849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.516894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.517128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.517426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.517426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-376e6dd8-16cb-4271-824c-44a7cc4e6a5c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.643753] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e05885f7-f90c-4dc8-a8cd-863cca4aa18b None None] Enqueued Resource ID: a5a69541-eda7-45ad-802b-efe9dc4ff3f7 with Priority: HIGHEST for action port [ 694.646798] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a69541-eda7-45ad-802b-efe9dc4ff3f7 with Priority: HIGHEST for action port [ 694.650113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5a69541-eda7-45ad-802b-efe9dc4ff3f7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.650294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5a69541-eda7-45ad-802b-efe9dc4ff3f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.651510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5a69541-eda7-45ad-802b-efe9dc4ff3f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.651510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5a69541-eda7-45ad-802b-efe9dc4ff3f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.651510] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5a69541-eda7-45ad-802b-efe9dc4ff3f7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.866810] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.867032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.867113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.867387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.867532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.867811] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.867908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.867963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.868167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.868314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.868383] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e is going to be updated. [ 694.914947] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.915154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.915259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.915409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.915548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.932990] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: IN_PROGRESS for 2s [ 694.967067] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.000162] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.130192] env[65738]: INFO networking_nsxv3.common.synchronization [req-b02ab42d-217a-4cd0-9174-3abc9e23f964 req-7ff4ebae-7dea-4d3c-b4f4-f6ccbb756496 tempest-InstanceActionsNegativeTestJSON-512862046 tempest-InstanceActionsNegativeTestJSON-512862046-project-member] Enqueued Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 695.130789] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 695.131731] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.132427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.132427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.132771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.134154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.134334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.134439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.134655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.134748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.134883] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.158217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5a69541-eda7-45ad-802b-efe9dc4ff3f7 [ 695.160506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.160506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.160506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.160506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.160506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.160506] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5a69541-eda7-45ad-802b-efe9dc4ff3f7 already deleted. [ 695.160506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5a69541-eda7-45ad-802b-efe9dc4ff3f7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.482043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.482043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.482043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.482043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.482043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.482043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be created. [ 695.504949] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.506960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.507193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.507193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.507399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.507562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.522849] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: UNINITIALIZED for 2s [ 695.637912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.638147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.639023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.639023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.639023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.643122] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.643424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.643516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.643936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.644280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.644329] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 already deleted. [ 695.644446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.753497] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.753497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.753497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.753497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.753497] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.758046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.758046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.758046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.758046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.758046] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.758046] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.758046] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.758046] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.758046] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.758046] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.758046] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.788745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.788971] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.789272] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.789438] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-443" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.790021] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b81b74ac-ce2f-4f63-849c-a748ec880275 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.790263] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.790381] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.790845] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.791382] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81b74ac-ce2f-4f63-849c-a748ec880275',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.010369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.010534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.010606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.010842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.010951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.011069] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 696.054399] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.054575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.054610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.054935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.055130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.072690] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 696.297462] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.297956] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.298508] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.298973] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.299305] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.299627] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b81b74ac-ce2f-4f63-849c-a748ec880275 not found, creating... [ 696.300116] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.300378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.300558] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.300912] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.301150] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.301716] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.302075] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.302270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.302619] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.302866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.303099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b81b74ac-ce2f-4f63-849c-a748ec880275 is going to be created. [ 696.334525] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.334865] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.335092] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.335479] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.335777] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.336074] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.551036] env[65738]: INFO networking_nsxv3.common.synchronization [None req-97af8b5e-3fb5-4057-8209-736200d51542 tempest-ServersTestManualDisk-1852094496 tempest-ServersTestManualDisk-1852094496-project-member] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 696.552194] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 696.552655] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.552814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.552913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.553250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.553364] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.831333] env[65738]: INFO networking_nsxv3.common.synchronization [None req-777797ee-a32b-4ba2-8fcf-e975b469713d tempest-ServersTestManualDisk-1852094496 tempest-ServersTestManualDisk-1852094496-project-member] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 696.832073] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 696.832440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.832538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.945367] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e in Status: SUCCESS [ 696.945546] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e deletion is rescheduled due to dependency. [ 696.945668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.077118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.077284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.077338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.077562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.077647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.077943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa already deleted. [ 697.077943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.078045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.078835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.078835] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.090419] env[65738]: INFO networking_nsxv3.common.synchronization [req-b02ab42d-217a-4cd0-9174-3abc9e23f964 req-68b41d29-8e19-47a9-a55f-1bdf923eb995 service nova] Enqueued Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_rules [ 697.090591] env[65738]: INFO networking_nsxv3.common.synchronization [req-b02ab42d-217a-4cd0-9174-3abc9e23f964 req-68b41d29-8e19-47a9-a55f-1bdf923eb995 service nova] Enqueued Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 697.090728] env[65738]: INFO networking_nsxv3.common.synchronization [req-b02ab42d-217a-4cd0-9174-3abc9e23f964 req-68b41d29-8e19-47a9-a55f-1bdf923eb995 service nova] Enqueued Resource ID: b81b74ac-ce2f-4f63-849c-a748ec880275 with Priority: HIGHEST for action port [ 697.091418] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_rules [ 697.091555] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 697.091651] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81b74ac-ce2f-4f63-849c-a748ec880275 with Priority: HIGHEST for action port [ 697.092448] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.092621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.092713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.093118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.093238] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.098716] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.098716] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.098716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.098716] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.099537] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b81b74ac-ce2f-4f63-849c-a748ec880275 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.099647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.099709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.099880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.099952] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81b74ac-ce2f-4f63-849c-a748ec880275',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.484090] env[65738]: INFO networking_nsxv3.common.synchronization [req-639ff78e-b731-4f54-aa2f-893adc975f31 req-0bb05f3e-05ec-47fa-be63-0a5856c45f00 tempest-InstanceActionsTestJSON-346229597 tempest-InstanceActionsTestJSON-346229597-project-member] Enqueued Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 697.484090] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 697.484090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.484288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.484288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.484460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.484621] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.484727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.484782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.484935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.485040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.485137] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.534045] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 697.534488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.534717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.535471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.535699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.535820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.535890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.536075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.536173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.536274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.536332] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.601668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.601960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.603056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.603183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.603255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.603459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.604106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.604106] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa already deleted. [ 697.604106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.604106] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.605552] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b81b74ac-ce2f-4f63-849c-a748ec880275 with status ACTIVE [ 697.605552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.606093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.607258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.607473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.607619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.607839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.608170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.608170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.608280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.608374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.608642] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.608754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.608829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.609543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.609543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.609543] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b81b74ac-ce2f-4f63-849c-a748ec880275 is going to be updated. [ 697.636128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.636877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.636877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.637059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.637310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.637533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b81b74ac-ce2f-4f63-849c-a748ec880275" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.863582] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.863920] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-153" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.864151] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-153" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.864539] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-153" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.864941] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.865182] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.865366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.865668] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.865876] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.866195] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.866357] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.866537] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.866692] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.866849] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.867015] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.867212] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.895678] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.895838] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.895967] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.896169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-153" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.896481] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-45720564-0e63-4fd3-970b-5c6068e97e5e taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.896644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.896757] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.897086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.897213] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45720564-0e63-4fd3-970b-5c6068e97e5e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.987689] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.988716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.988716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.988716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.988716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.988892] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.988960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.989019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.989161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.989236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.989324] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 already deleted. [ 697.989461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.039877] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.040052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.040137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.040364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.040558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.040704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.040794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.040960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.041084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.041175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.041372] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.041462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.041526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.042780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.042780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.042780] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.082313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 698.082577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.082776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.083037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.083274] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.083985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.083985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.083985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.083985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.083985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.083985] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.085131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.086196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.086196] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.111104] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.402337] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.403270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.404474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.404474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.404474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.404474] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 45720564-0e63-4fd3-970b-5c6068e97e5e not found, creating... [ 698.404474] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.408138] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.408439] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.409608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.409608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.409608] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.409608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.409608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.409881] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.414486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.414486] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 45720564-0e63-4fd3-970b-5c6068e97e5e is going to be created. [ 698.439044] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.439044] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.439044] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.439044] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.439320] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.439421] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.545036] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84a7a11-9309-4895-a6a4-e6d1f1dddb0b: rpc.has_security_group_logging(os_id): False [ 698.572859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.573135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.573135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.573237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.573282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.573706] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.573914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.573914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.574081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.574163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.574387] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.574478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.574551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.574693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.574768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.574957] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.575155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.575241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.575411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.575509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.575617] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be created. [ 698.588060] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.589636] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.590118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.614451] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.614735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.614735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.615250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.615422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.615573] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 is going to be created. [ 698.672726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.673049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.673049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.673235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.673430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.694044] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: UNINITIALIZED for 2s [ 698.712834] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.713559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.713559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.713559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.713559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.730338] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 699.091910] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.167563] env[65738]: INFO networking_nsxv3.common.synchronization [req-639ff78e-b731-4f54-aa2f-893adc975f31 req-ed080fdd-fe1c-4650-a1d4-3b80e27363da service nova] Enqueued Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_rules [ 699.168139] env[65738]: INFO networking_nsxv3.common.synchronization [req-639ff78e-b731-4f54-aa2f-893adc975f31 req-ed080fdd-fe1c-4650-a1d4-3b80e27363da service nova] Enqueued Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 699.168139] env[65738]: INFO networking_nsxv3.common.synchronization [req-639ff78e-b731-4f54-aa2f-893adc975f31 req-ed080fdd-fe1c-4650-a1d4-3b80e27363da service nova] Enqueued Resource ID: 45720564-0e63-4fd3-970b-5c6068e97e5e with Priority: HIGHEST for action port [ 699.168821] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_rules [ 699.168968] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 699.169703] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45720564-0e63-4fd3-970b-5c6068e97e5e with Priority: HIGHEST for action port [ 699.169886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.170027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.170090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.170363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.170434] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.171374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.171505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.171574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.171748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.172128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.172128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.172128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.173323] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.173527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-45720564-0e63-4fd3-970b-5c6068e97e5e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.173527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.173659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173776] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45720564-0e63-4fd3-970b-5c6068e97e5e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.595400] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.598081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.598081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.598081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.598081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.598081] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 699.646203] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.646325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.646325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.646792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.660854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 699.675467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.675733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.679517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45720564-0e63-4fd3-970b-5c6068e97e5e with status ACTIVE [ 699.680100] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.681159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.681275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.681453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.681543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.681757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.681923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.681992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.684023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.684023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.684023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45720564-0e63-4fd3-970b-5c6068e97e5e is going to be updated. [ 699.684023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.710953] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.710953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.710953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.710953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.710953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.710953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45720564-0e63-4fd3-970b-5c6068e97e5e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.189487] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.691792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.692036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.692114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.692354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.692444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.692552] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 is going to be created. [ 700.704235] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: SUCCESS [ 700.704599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.704855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.705187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.705472] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.705649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.705879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.705986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.706136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.706270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.706456] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.719955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.719955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.720086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.720243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.720450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.733616] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: UNINITIALIZED for 2s [ 700.752249] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 700.752542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.211526] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.212421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.212421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.212421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.212421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.212421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.212421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.212686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.212686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.213713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.213713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.213713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.214073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.214073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.214073] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.673400] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 701.673869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.673971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.677432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.677628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.677817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.677976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.678056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.678203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.678373] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.678523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.678558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.678742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.678953] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.679104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.679104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.679332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.679332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.679450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.679926] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.717182] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ad6c20a-9f8d-463c-b372-a35a03d15c46: rpc.has_security_group_logging(os_id): False [ 701.739854] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.740126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.740126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.742138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.742138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.742357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.742357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.742357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.742569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.742605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.742772] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.742873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.744408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.744408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.744408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.744408] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 is going to be created. [ 701.870922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.870922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.870922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.870922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.870922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.887046] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: IN_PROGRESS for 2s [ 701.896753] env[65738]: INFO networking_nsxv3.common.synchronization [req-27eab661-54ed-4323-ba02-3e04437248ed req-e2252105-9802-44fa-815c-255cf6960737 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 701.898151] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 701.898151] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.898151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.898151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.898151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.898787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.898787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.898787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.898787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.898787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.898787] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.183293] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194d1d45-daf3-4873-a0c4-a279f2704021: rpc.has_security_group_logging(os_id): False [ 702.207579] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.207664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.208341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.208635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.208744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.209041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.209184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.209286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.210054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.210054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.210054] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.210336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.210403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.210561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.210634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.210894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.211062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.211177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.211683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.211683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.212034] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 702.292852] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.292996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.293046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.293295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.293472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.314391] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 702.402981] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.426317] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.426317] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.426317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.426317] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.426317] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.426317] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.426317] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.426806] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.426806] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.426806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.454959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.455242] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.455420] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.455617] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.455966] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-70853dcb-1ebd-443d-aa19-34977ee7a872 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.456212] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.456404] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.456780] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.457016] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70853dcb-1ebd-443d-aa19-34977ee7a872',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.750197] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: SUCCESS [ 702.750197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.750197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.750197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.750197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.751276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.751276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.751276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.751276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.751276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.751276] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.768575] env[65738]: INFO networking_nsxv3.common.synchronization [None req-fc96907a-0129-423a-93a8-16d25b4a7db5 None None] Enqueued Resource ID: c10c4f0d-9aeb-467e-bed0-56a1731e3077 with Priority: HIGHEST for action port [ 702.769208] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10c4f0d-9aeb-467e-bed0-56a1731e3077 with Priority: HIGHEST for action port [ 702.769601] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10c4f0d-9aeb-467e-bed0-56a1731e3077 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.769751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10c4f0d-9aeb-467e-bed0-56a1731e3077" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.769822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10c4f0d-9aeb-467e-bed0-56a1731e3077" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.771389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10c4f0d-9aeb-467e-bed0-56a1731e3077" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.771389] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10c4f0d-9aeb-467e-bed0-56a1731e3077',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.906812] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.960609] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.961015] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.961366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.961724] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.961948] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.962203] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 70853dcb-1ebd-443d-aa19-34977ee7a872 not found, creating... [ 702.963819] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.963819] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.963819] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.964310] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.964393] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.964839] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.965129] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.965351] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.965720] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.965953] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.966237] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 70853dcb-1ebd-443d-aa19-34977ee7a872 is going to be created. [ 702.992884] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.993218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.993629] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.994230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.994571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.994950] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.255126] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.256378] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.256378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.257563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.257801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.258049] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.258175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.258313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.258839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.258839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.258839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.258839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.259106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.259106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.259908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.259908] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.274304] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c10c4f0d-9aeb-467e-bed0-56a1731e3077 [ 703.274649] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.274816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.274973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.275146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.275250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.275385] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c10c4f0d-9aeb-467e-bed0-56a1731e3077 already deleted. [ 703.275504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10c4f0d-9aeb-467e-bed0-56a1731e3077" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.412051] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.412051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.412051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.412051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.412305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.412305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 703.445571] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.445571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.445571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.445571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.445571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.458935] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 703.726976] env[65738]: INFO networking_nsxv3.common.synchronization [req-27eab661-54ed-4323-ba02-3e04437248ed req-1b89819d-e063-490e-a5a7-797aacc19c84 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 703.727482] env[65738]: INFO networking_nsxv3.common.synchronization [req-27eab661-54ed-4323-ba02-3e04437248ed req-1b89819d-e063-490e-a5a7-797aacc19c84 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 703.727482] env[65738]: INFO networking_nsxv3.common.synchronization [req-27eab661-54ed-4323-ba02-3e04437248ed req-1b89819d-e063-490e-a5a7-797aacc19c84 service nova] Enqueued Resource ID: 70853dcb-1ebd-443d-aa19-34977ee7a872 with Priority: HIGHEST for action port [ 703.727772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 703.727772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 703.727772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70853dcb-1ebd-443d-aa19-34977ee7a872 with Priority: HIGHEST for action port [ 703.728560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.728560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.728560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.728782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.728854] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.730189] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.730189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.730799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-70853dcb-1ebd-443d-aa19-34977ee7a872 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.730799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.730799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.730799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.731077] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70853dcb-1ebd-443d-aa19-34977ee7a872',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.763706] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93ac889c-a70d-42e4-9f0a-90c362835c16: rpc.has_security_group_logging(os_id): False [ 703.787313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.787514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.787514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.787722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.787821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.788054] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.788161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.788212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.788374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.788442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.789024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.789024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.789024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.789215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.789215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.789379] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.789532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.789635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.791096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.791096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.791096] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 is going to be created. [ 703.852434] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.852434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.852434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.852434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.852434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.864555] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: IN_PROGRESS for 2s [ 703.917327] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: SUCCESS [ 703.917327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.232752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.232926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.234959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70853dcb-1ebd-443d-aa19-34977ee7a872 with status ACTIVE [ 704.235236] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.235389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.235463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.235675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.235904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.235971] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.236103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.236447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.236447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.236506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.236661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.236823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.236948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.237057] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70853dcb-1ebd-443d-aa19-34977ee7a872 is going to be updated. [ 704.270166] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.270584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.270584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.270654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.270788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.270942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70853dcb-1ebd-443d-aa19-34977ee7a872" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.337949] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 704.338310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.339378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.339378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.339378] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.427016] env[65738]: INFO networking_nsxv3.common.synchronization [req-73073def-90a7-4a19-bb11-352cae32e1c1 req-41bceabc-7979-4cdc-8497-ca2ef6de48c9 tempest-ServersNegativeTestJSON-2088787331 tempest-ServersNegativeTestJSON-2088787331-project-member] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 704.428247] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 704.428718] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.428902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.428993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.430107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.430107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.430324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.430452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.431272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.431272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.431440] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.748398] env[65738]: INFO networking_nsxv3.common.synchronization [None req-161773d0-6bdd-4104-944c-8ae458d4c502 None None] Enqueued Resource ID: fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141 with Priority: HIGHEST for action port [ 704.748994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141 with Priority: HIGHEST for action port [ 704.749405] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.749852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.750104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.750417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.750487] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.842403] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.842403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.842747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.842907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.843041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.843153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.844141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.844141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.844141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.844141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.844141] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.876318] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.876318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.876318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.876318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.877447] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.877681] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.877814] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.878087] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.878247] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.878457] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.878581] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.878688] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.878822] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.878937] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.879070] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.879206] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.904981] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.905639] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.905639] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.906095] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.906537] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.907653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.907653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.907653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.907653] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919e0b81-8c2d-42c4-ac9f-8ba0c7529489',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.935311] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.935311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.935311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.935311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.935311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.935311] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.935311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.935758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.935758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.935872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.936086] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 already deleted. [ 704.936138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.252701] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141 [ 705.252828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.252920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.252970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.253250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.253459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.253521] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141 already deleted. [ 705.253608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1f924d-1ed4-49d3-b9e4-ad1d6e31a141" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.347252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.347574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.347574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.347773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.347969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.348147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.348230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.348406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.348488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.349563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.349745] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.349850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.349917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.350203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.350361] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.350490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.350553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.350696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.350798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.350940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.350990] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.411472] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.411638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.411638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.412100] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.412178] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.412310] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 not found, creating... [ 705.412591] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.412755] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.412866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.413224] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.413366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.414024] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.414024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.414024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.414355] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.414510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.414648] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 is going to be created. [ 705.438036] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.438036] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.438036] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.438269] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.438447] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.438629] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.475134] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.475134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.475134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.475134] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.856965] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194d1d45-daf3-4873-a0c4-a279f2704021: rpc.has_security_group_logging(os_id): False [ 705.891808] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: SUCCESS [ 705.891808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.893495] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.893495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.893495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.898855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.899101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.899342] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.899485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.899585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.899740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.899817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.900082] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.900220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.900289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.900562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.900562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.900731] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.902187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.902187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.902187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.902187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.902187] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 705.977795] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.010405] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.010735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.010735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.010990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.011160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.053839] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 706.287326] env[65738]: INFO networking_nsxv3.common.synchronization [req-73073def-90a7-4a19-bb11-352cae32e1c1 req-d199dbf0-6c93-45d0-9653-b70d9a5c140d service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 706.287634] env[65738]: INFO networking_nsxv3.common.synchronization [req-73073def-90a7-4a19-bb11-352cae32e1c1 req-d199dbf0-6c93-45d0-9653-b70d9a5c140d service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 706.287681] env[65738]: INFO networking_nsxv3.common.synchronization [req-73073def-90a7-4a19-bb11-352cae32e1c1 req-d199dbf0-6c93-45d0-9653-b70d9a5c140d service nova] Enqueued Resource ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with Priority: HIGHEST for action port [ 706.288363] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 706.288564] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 706.288640] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with Priority: HIGHEST for action port [ 706.288935] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.290578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.290730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.291158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.292627] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.292794] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.292975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.293061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.293318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.293809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.294721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.294721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.294721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.294721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.298129] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.301527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.301527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.301527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.301527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.301527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919e0b81-8c2d-42c4-ac9f-8ba0c7529489',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.480169] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.810027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.810027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.810027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with status ACTIVE [ 706.810027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.810027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.810027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.816449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.816449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.816449] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 is going to be updated. [ 706.841412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.841772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.841880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.842718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.842718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.842718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985651] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.985651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.985651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985651] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 707.032060] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.032060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.032060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.032060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.032060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.049431] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 707.316396] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.818719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.819036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.819036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.819382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.819522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.819676] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be created. [ 707.855307] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.855566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.855664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.855971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.856494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.881165] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: UNINITIALIZED for 2s [ 708.093268] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 708.093604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.060670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 709.060922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.061105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.061358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.061567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.061733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.061810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.061965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.062139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.062277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.062405] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.445875] env[65738]: INFO networking_nsxv3.common.synchronization [None req-8191d0c8-f66d-493a-a5d5-e8511518aef9 None None] Enqueued Resource ID: 57081b50-3100-4ee8-83b7-07dd1f4c2c61 with Priority: HIGHEST for action port [ 709.446495] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57081b50-3100-4ee8-83b7-07dd1f4c2c61 with Priority: HIGHEST for action port [ 709.448399] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-57081b50-3100-4ee8-83b7-07dd1f4c2c61 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.448559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57081b50-3100-4ee8-83b7-07dd1f4c2c61" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.448629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57081b50-3100-4ee8-83b7-07dd1f4c2c61" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.448894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57081b50-3100-4ee8-83b7-07dd1f4c2c61" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.448982] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57081b50-3100-4ee8-83b7-07dd1f4c2c61',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.565293] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.565536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.565634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.565955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.566224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.566370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.566464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.566703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.566834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.566975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.567211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.567360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.567454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.567682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.567900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.568449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.568554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.570433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.570433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.570536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.570600] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.895973] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 709.896117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.896335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.896648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.897743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.897743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.897743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.897743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.897743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.897905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.897979] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.952621] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57081b50-3100-4ee8-83b7-07dd1f4c2c61 [ 709.954820] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.954820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.954820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.954820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.954820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.954820] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57081b50-3100-4ee8-83b7-07dd1f4c2c61 already deleted. [ 709.955981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57081b50-3100-4ee8-83b7-07dd1f4c2c61" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.074338] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84a7a11-9309-4895-a6a4-e6d1f1dddb0b: rpc.has_security_group_logging(os_id): False [ 710.094928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.095054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.095093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.095708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.095876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.096129] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.096289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.096289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.096468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.096546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.096946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.096946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.096946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.097256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.097365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.097567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.097662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.097725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.097866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.097948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.098050] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 710.182208] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.182335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.182378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.184231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.184231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.258612] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 710.404153] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.404290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.404350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.404791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.404898] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.405092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.405145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.405396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.405471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.405614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.405872] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.406072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.406129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.406306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.406590] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.406590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.406706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.406811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.406845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.406997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.409329] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.916834] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89618efc-1c71-4f3b-9cfc-d651fcf1fe99: rpc.has_security_group_logging(os_id): False [ 710.945643] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.948859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.948859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.948859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.949530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.949530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.953991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.953991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.953991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.953991] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be created. [ 711.058675] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.058675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.058675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.058675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.058675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.077524] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 711.926606] env[65738]: INFO networking_nsxv3.common.synchronization [None req-8dd5f4b3-0456-4698-a6b1-170c41965431 None None] Enqueued Resource ID: 1b39e321-2f85-44d9-b8cc-60a6e8096200 with Priority: HIGHEST for action port [ 711.927383] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b39e321-2f85-44d9-b8cc-60a6e8096200 with Priority: HIGHEST for action port [ 711.927839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b39e321-2f85-44d9-b8cc-60a6e8096200 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.928088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b39e321-2f85-44d9-b8cc-60a6e8096200" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.928088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b39e321-2f85-44d9-b8cc-60a6e8096200" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.928461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b39e321-2f85-44d9-b8cc-60a6e8096200" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.928564] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b39e321-2f85-44d9-b8cc-60a6e8096200',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.279102] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 712.279102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.431461] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b39e321-2f85-44d9-b8cc-60a6e8096200 [ 712.431461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.431703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.431703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.431912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.432016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.433350] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b39e321-2f85-44d9-b8cc-60a6e8096200 already deleted. [ 712.433809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b39e321-2f85-44d9-b8cc-60a6e8096200" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.550453] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b06f663e-404d-4609-bfbd-09a2757f7030 None None] Enqueued Resource ID: 5a54cdeb-998e-455d-bafe-83a2b032594b with Priority: HIGHEST for action port [ 712.550453] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a54cdeb-998e-455d-bafe-83a2b032594b with Priority: HIGHEST for action port [ 712.551917] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a54cdeb-998e-455d-bafe-83a2b032594b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.552641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a54cdeb-998e-455d-bafe-83a2b032594b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.552873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a54cdeb-998e-455d-bafe-83a2b032594b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.556557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a54cdeb-998e-455d-bafe-83a2b032594b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.556557] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a54cdeb-998e-455d-bafe-83a2b032594b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.778113] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b18817f7-28b0-42f6-8b3d-e0c5eb644a4a tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 712.778113] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 712.778113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.778113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.778623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.778623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.778623] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.059482] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a54cdeb-998e-455d-bafe-83a2b032594b [ 713.059482] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.059482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.059482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.059482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.059482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.059482] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a54cdeb-998e-455d-bafe-83a2b032594b already deleted. [ 713.059482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a54cdeb-998e-455d-bafe-83a2b032594b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.094666] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 713.094666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.214676] env[65738]: INFO networking_nsxv3.common.synchronization [req-b0952a40-0fd4-41af-91a2-2e57cf79e3bb req-a8012199-9794-4879-bd7f-9486e100701f tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 713.216112] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 713.216112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.216112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.216112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.218560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.218560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.218560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.218560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.218560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.218560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.218560] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.310210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.310585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.310585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.310722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.310722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.311126] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 already deleted. [ 713.311126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.346206] env[65738]: INFO networking_nsxv3.common.synchronization [None req-963ab16f-1977-426b-9414-f7a3185b62fe tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 713.346206] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 713.346206] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.346206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.346553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.346924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.347353] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.720449] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.768181] env[65738]: INFO networking_nsxv3.common.synchronization [req-b0952a40-0fd4-41af-91a2-2e57cf79e3bb req-628acb16-e126-483c-8f38-09700a5c6e5c tempest-ServersTestMultiNic-1938075170 tempest-ServersTestMultiNic-1938075170-project-member] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 713.768805] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGHEST for action security_group_members [ 713.769293] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.769425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.868800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.868940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.869017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.869249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.869341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.869436] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 already deleted. [ 713.869514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.154172] env[65738]: INFO networking_nsxv3.common.synchronization [None req-4f82e845-aecc-4ed1-b840-d3d864b09fab None None] Enqueued Resource ID: faaa8040-f277-423a-b563-ab45a6dd3135 with Priority: HIGHEST for action port [ 714.162433] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faaa8040-f277-423a-b563-ab45a6dd3135 with Priority: HIGHEST for action port [ 714.162433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-faaa8040-f277-423a-b563-ab45a6dd3135 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.162433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faaa8040-f277-423a-b563-ab45a6dd3135" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.162433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faaa8040-f277-423a-b563-ab45a6dd3135" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.162433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faaa8040-f277-423a-b563-ab45a6dd3135" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.162433] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faaa8040-f277-423a-b563-ab45a6dd3135',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.223905] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.343622] env[65738]: INFO networking_nsxv3.common.synchronization [None req-f17ea05f-a38a-4e06-8d15-0cae3f422c4d None None] Enqueued Resource ID: 2c5e09c3-2616-4f1c-add6-c0170debaa24 with Priority: HIGHEST for action port [ 714.344682] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c5e09c3-2616-4f1c-add6-c0170debaa24 with Priority: HIGHEST for action port [ 714.346272] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c5e09c3-2616-4f1c-add6-c0170debaa24 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.346400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c5e09c3-2616-4f1c-add6-c0170debaa24" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.346461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c5e09c3-2616-4f1c-add6-c0170debaa24" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.346708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c5e09c3-2616-4f1c-add6-c0170debaa24" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.346837] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c5e09c3-2616-4f1c-add6-c0170debaa24',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.665258] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faaa8040-f277-423a-b563-ab45a6dd3135 [ 714.667112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.667112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.667112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.667112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.667112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.667112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faaa8040-f277-423a-b563-ab45a6dd3135 already deleted. [ 714.667112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faaa8040-f277-423a-b563-ab45a6dd3135" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.732434] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.732434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.732434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.732434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.732434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.732434] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 714.768251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.768404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.768477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.768716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.768875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.781445] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 714.853776] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c5e09c3-2616-4f1c-add6-c0170debaa24 [ 714.853776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.853776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.853776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.853776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.853776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.853776] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c5e09c3-2616-4f1c-add6-c0170debaa24 already deleted. [ 714.853776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c5e09c3-2616-4f1c-add6-c0170debaa24" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.559830] env[65738]: INFO networking_nsxv3.common.synchronization [req-257ce711-159d-4079-89dd-6182e0415c85 req-171b40e8-a2ca-46a8-afb2-c209c19f1194 tempest-ServersTestFqdnHostnames-505815451 tempest-ServersTestFqdnHostnames-505815451-project-member] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 715.563865] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 715.563865] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563865] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.564682] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.068635] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-257" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-257" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-257" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.068635] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.068635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.068635] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.068635] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.068635] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.068635] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.069561] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.069561] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.069561] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.069561] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.069561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.069561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.069561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.069832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.069832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.069923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.069962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.070554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.070554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.070554] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 already deleted. [ 716.070554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.096390] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.096390] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.096390] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.096390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-257" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.096390] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.096390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.097029] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.097029] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.099426] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6efd248-f4ae-4981-aa0b-21ca80e08eeb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.480143] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7e477f2d-3528-48c2-8ed5-83f227189150 None None] Enqueued Resource ID: b0eaa261-a066-46e1-ad46-1960cec4a003 with Priority: HIGHEST for action port [ 716.481076] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0eaa261-a066-46e1-ad46-1960cec4a003 with Priority: HIGHEST for action port [ 716.481076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0eaa261-a066-46e1-ad46-1960cec4a003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.481250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0eaa261-a066-46e1-ad46-1960cec4a003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.481250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0eaa261-a066-46e1-ad46-1960cec4a003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.481594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0eaa261-a066-46e1-ad46-1960cec4a003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.481704] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0eaa261-a066-46e1-ad46-1960cec4a003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.605938] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.605938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.605938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.605938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.605938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.605938] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port f6efd248-f4ae-4981-aa0b-21ca80e08eeb not found, creating... [ 716.605938] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.605938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.606660] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.606660] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.606660] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.606774] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.607875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.607875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.607875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.607875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.607875] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: f6efd248-f4ae-4981-aa0b-21ca80e08eeb is going to be created. [ 716.633100] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.633378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.634293] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.634793] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.635130] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.635694] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.794379] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 716.794617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.794798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.795015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.795210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.795327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.795396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.799059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.799059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.799059] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.984064] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0eaa261-a066-46e1-ad46-1960cec4a003 [ 716.984295] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.984485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.984485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.984785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.984880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.984978] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0eaa261-a066-46e1-ad46-1960cec4a003 already deleted. [ 716.985152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0eaa261-a066-46e1-ad46-1960cec4a003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.986480] env[65738]: INFO networking_nsxv3.common.synchronization [req-3b2b29af-0db5-4d30-9d11-d810fcd78719 req-adb54ac9-550a-4a6b-b6f6-613dc200bf80 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 716.987828] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 716.988452] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.988452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.988707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.988954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.989257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.989556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.989556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.989832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.990078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.990296] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.298040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.298040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.301066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.301066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.301066] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be updated. [ 717.336238] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.336238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.336448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.336705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.336705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.348217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: IN_PROGRESS for 2s [ 717.368304] env[65738]: INFO networking_nsxv3.common.synchronization [req-257ce711-159d-4079-89dd-6182e0415c85 req-11eb6505-ee57-473a-ba20-dc04976f02f6 service nova] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 717.368491] env[65738]: INFO networking_nsxv3.common.synchronization [req-257ce711-159d-4079-89dd-6182e0415c85 req-11eb6505-ee57-473a-ba20-dc04976f02f6 service nova] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 717.368693] env[65738]: INFO networking_nsxv3.common.synchronization [req-257ce711-159d-4079-89dd-6182e0415c85 req-11eb6505-ee57-473a-ba20-dc04976f02f6 service nova] Enqueued Resource ID: f6efd248-f4ae-4981-aa0b-21ca80e08eeb with Priority: HIGHEST for action port [ 717.369268] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_rules [ 717.369407] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 717.369502] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6efd248-f4ae-4981-aa0b-21ca80e08eeb with Priority: HIGHEST for action port [ 717.369781] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.369925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.369989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.370614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.370735] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.375752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.375752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.375752] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.375752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.375752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.375752] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6efd248-f4ae-4981-aa0b-21ca80e08eeb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.495382] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.495643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.495924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.496074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.496280] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.496440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.496440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.496671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.496671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.496671] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 717.530256] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.530424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.531159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.531159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.531159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.549775] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 717.800748] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.800748] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.801133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.801133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.805264] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.805264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.805264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.805264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.805264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.805264] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.805264] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.805264] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.805264] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.805264] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.805264] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.805264] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.823235] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.823427] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.823564] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.823732] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.824254] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-0151d997-6f17-468c-a180-9077529870d0 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.824254] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.824469] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.824864] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.824864] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0151d997-6f17-468c-a180-9077529870d0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.876375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.876579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.876733] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6efd248-f4ae-4981-aa0b-21ca80e08eeb with status ACTIVE [ 717.877203] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.877203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.877203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.877492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.877492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.877607] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.878149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.878149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.878149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.878149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.878360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.878360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.878360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.878472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.878534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.879736] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6efd248-f4ae-4981-aa0b-21ca80e08eeb is going to be updated. [ 717.880664] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.923969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.924159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.924218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.924501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.925034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.925034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6efd248-f4ae-4981-aa0b-21ca80e08eeb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.013034] env[65738]: INFO networking_nsxv3.common.synchronization [None req-1b7d12d1-ee56-41fd-ad8c-5a2a5a887b90 tempest-ServerActionsV293TestJSON-1184867836 tempest-ServerActionsV293TestJSON-1184867836-project-member] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 718.014747] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 718.014747] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.014747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.014747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.014747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.014747] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.150198] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6f6312b5-cfcd-413f-81e3-c2e6b1d869cd tempest-ServerActionsV293TestJSON-1184867836 tempest-ServerActionsV293TestJSON-1184867836-project-member] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 718.150770] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 718.151229] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.151297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.328384] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.328625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.328728] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.329078] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.329240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.329428] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 0151d997-6f17-468c-a180-9077529870d0 not found, creating... [ 718.329857] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.329995] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.330258] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.330471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.330646] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.330985] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.331180] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.331326] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.331573] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.331718] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.331859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 0151d997-6f17-468c-a180-9077529870d0 is going to be created. [ 718.366575] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.366856] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.367032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.367198] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.367425] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.367685] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.383571] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.546984] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.547190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.547190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.547439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.547548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.547644] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 already deleted. [ 718.547749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.547911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.548120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.548204] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.888831] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.889170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.889170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.889281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.889413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.889593] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 is going to be created. [ 718.916292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.916448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.916540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.916820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.916919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.931844] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: UNINITIALIZED for 2s [ 719.075673] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.075821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.076583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.076856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.076949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.077072] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 already deleted. [ 719.077161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.156435] env[65738]: INFO networking_nsxv3.common.synchronization [req-3b2b29af-0db5-4d30-9d11-d810fcd78719 req-fb7f86f9-1d15-4add-9f0a-af6df99e4d02 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 719.156435] env[65738]: INFO networking_nsxv3.common.synchronization [req-3b2b29af-0db5-4d30-9d11-d810fcd78719 req-fb7f86f9-1d15-4add-9f0a-af6df99e4d02 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 719.156435] env[65738]: INFO networking_nsxv3.common.synchronization [req-3b2b29af-0db5-4d30-9d11-d810fcd78719 req-fb7f86f9-1d15-4add-9f0a-af6df99e4d02 service nova] Enqueued Resource ID: 0151d997-6f17-468c-a180-9077529870d0 with Priority: HIGHEST for action port [ 719.157460] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 719.157611] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 719.159502] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0151d997-6f17-468c-a180-9077529870d0 with Priority: HIGHEST for action port [ 719.159502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.159502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.159502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.159502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.159502] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.160324] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.160829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.161252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0151d997-6f17-468c-a180-9077529870d0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.161451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.161519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.161792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.162182] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0151d997-6f17-468c-a180-9077529870d0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.360794] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194d1d45-daf3-4873-a0c4-a279f2704021 in Status: SUCCESS [ 719.360999] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 deletion is rescheduled due to dependency. [ 719.361117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.452770] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a4084df-f655-4743-bec4-ff39e2675023 req-82322923-fa94-4519-916e-40cff1be99d9 tempest-ServersTestManualDisk-1852094496 tempest-ServersTestManualDisk-1852094496-project-member] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 719.453717] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 719.454684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.454829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.454952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.455723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.455723] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.455723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.455723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.455723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.455981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.455981] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.563341] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 719.563530] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 719.563645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.563818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.564043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.564236] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.564355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.564419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.564672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.564757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.564855] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.662396] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.662396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.666407] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0151d997-6f17-468c-a180-9077529870d0 with status ACTIVE [ 719.666639] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.666778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.666854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.667077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.667167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.667357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.667496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.667623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.667748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.667817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.668038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.668206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.668252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.668370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.668429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.668516] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0151d997-6f17-468c-a180-9077529870d0 is going to be updated. [ 719.694202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.694421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.694775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.694922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.695105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0151d997-6f17-468c-a180-9077529870d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.963079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.963079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.963079] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa already deleted. [ 719.963079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.018194] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.018400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.018525] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.018904] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.019488] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.019488] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.019488] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.020644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.020644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.020772] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.021032] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.021032] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.021133] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.021672] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.021672] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.021672] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.044382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.044382] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.044599] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.044971] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.045490] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-222e50db-a350-4e4d-b287-4001437045b9 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.045764] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.045968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.046442] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.047150] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('222e50db-a350-4e4d-b287-4001437045b9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.071682] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.077977] env[65738]: INFO networking_nsxv3.common.synchronization [req-b5c965d5-f6dc-4b09-b10e-f5593b05edbc req-9c51f035-03ec-4ad7-addf-66be71a61f25 tempest-VolumesAssistedSnapshotsTest-42197642 tempest-VolumesAssistedSnapshotsTest-42197642-project-member] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 720.079460] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGHEST for action security_group_members [ 720.079460] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.079643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.079643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.079742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.079912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.079997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.080940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.080940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.080940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.080940] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.549645] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.549873] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.550011] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.550332] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.550659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.550659] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 222e50db-a350-4e4d-b287-4001437045b9 not found, creating... [ 720.550994] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.551251] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.551301] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.551719] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.551719] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.551885] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.552966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.553213] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.553508] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.553663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.553806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 222e50db-a350-4e4d-b287-4001437045b9 is going to be created. [ 720.573772] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.576073] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.576406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.576406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.576675] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.577170] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.577170] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.583421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.583585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.583636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.583813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.583898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.584098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.584195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.584256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.584402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.584472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.584559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd is going to be updated. [ 720.621861] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.622124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.622280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.622522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.622741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.633134] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: IN_PROGRESS for 2s [ 720.947056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: SUCCESS [ 720.947239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.947475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.947699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.947914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.948026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.948097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.948426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.948426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.948548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.948616] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.991565] env[65738]: INFO networking_nsxv3.common.synchronization [None req-19d95642-e6b4-4bba-a768-7dfbceb50ecc tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 720.992880] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 720.993268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.993420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.993488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.993742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.993827] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.079089] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.079291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.079353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.079567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.079663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.079770] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 721.114269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.114501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.114621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.114901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.115069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.126459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 721.220849] env[65738]: INFO networking_nsxv3.common.synchronization [req-d4e7d140-61a4-4097-8ab1-bc8b2989bd46 req-f22bb894-b320-4fdf-b971-2590fa289f0e tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 721.221437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 721.222534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.223555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.223678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.223949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.224095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.224204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.224264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.224445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.224556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.224656] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.285941] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a4084df-f655-4743-bec4-ff39e2675023 req-0b74b553-2679-4796-a9d8-6a707cca8c79 service nova] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 721.286093] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a4084df-f655-4743-bec4-ff39e2675023 req-0b74b553-2679-4796-a9d8-6a707cca8c79 service nova] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 721.286525] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a4084df-f655-4743-bec4-ff39e2675023 req-0b74b553-2679-4796-a9d8-6a707cca8c79 service nova] Enqueued Resource ID: 222e50db-a350-4e4d-b287-4001437045b9 with Priority: HIGHEST for action port [ 721.286719] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_rules [ 721.286853] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 721.286971] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 222e50db-a350-4e4d-b287-4001437045b9 with Priority: HIGHEST for action port [ 721.288168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.288168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.288168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.288168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.288168] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.294902] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.294902] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.294902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.294902] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.299774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-222e50db-a350-4e4d-b287-4001437045b9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.299904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.299961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.304041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.304041] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('222e50db-a350-4e4d-b287-4001437045b9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.433298] env[65738]: INFO networking_nsxv3.common.synchronization [None req-eb88387f-484b-4202-8129-7f5d60fa9e7f tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 721.434937] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 721.435267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.435429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.450690] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.455785] env[65738]: INFO networking_nsxv3.common.synchronization [req-681e96ec-37a0-40fe-9db8-db9f57909ae0 req-df0468e9-3d32-4035-8a73-80848cd899ae tempest-InstanceActionsNegativeTestJSON-512862046 tempest-InstanceActionsNegativeTestJSON-512862046-project-member] Enqueued Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 721.456056] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGHEST for action security_group_members [ 721.456343] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.456514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.456591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.456833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.456934] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.457160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457562] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.516707] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.516868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.516934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.517182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.517276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.517387] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d already deleted. [ 721.517471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.517612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.517778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.517885] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.727515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.727687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.727769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.727950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.728058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.728260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.728354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.728418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.728567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.728657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.728720] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 721.769422] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.769579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.769623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.769843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.770026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.783163] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 721.804654] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.805879] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.805987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.809038] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 222e50db-a350-4e4d-b287-4001437045b9 with status ACTIVE [ 721.809038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.809038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.809038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.809960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.809960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.809960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.809960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.809960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.809960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.809960] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 222e50db-a350-4e4d-b287-4001437045b9 is going to be updated. [ 721.859721] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.859906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.859948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.860633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.860633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.860633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-222e50db-a350-4e4d-b287-4001437045b9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.952914] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6395845-092a-4b5c-9563-8ce89b93f461: rpc.has_security_group_logging(os_id): False [ 721.959618] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.960024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.962293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.962619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.962742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.963045] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.963185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.964028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.964028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.964028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.964028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 is going to be updated. [ 721.981106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.981286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.981383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.981670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.982047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.982161] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.982266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.982348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.982574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.982685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.982804] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 is going to be created. [ 722.018728] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.018728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.018728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.019203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.019203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.036520] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: IN_PROGRESS for 2s [ 722.055725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.055725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.055725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.055725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.055725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.055725] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d already deleted. [ 722.055725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.087666] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.087666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.087666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.087666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.087666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.135493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: IN_PROGRESS for 2s [ 722.307357] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.648191] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f8f014-13fa-4be1-97eb-834dadab33fd in Status: SUCCESS [ 722.648666] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd deletion is rescheduled due to dependency. [ 722.648666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.811966] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.812157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.812311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.812547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.812649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.812768] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa is going to be created. [ 722.844652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.844811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.844881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.846092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.846891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.856515] env[65738]: INFO networking_nsxv3.common.synchronization [req-adb4c026-d252-4112-a5df-b74a78d64092 req-4d5e0361-daa9-426a-92b3-cb63cb5ad878 tempest-ServersAdminNegativeTestJSON-1268383286 tempest-ServersAdminNegativeTestJSON-1268383286-project-member] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 722.856564] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 722.856866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.856978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.858132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.858446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.858640] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.859819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.859819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.859819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.859819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.859819] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.860770] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: UNINITIALIZED for 2s [ 723.138570] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 723.138893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.138962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.139197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.139481] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.139596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.139596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.139713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.139795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.139878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.139967] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.282956] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.283210] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.283441] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.285779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.285779] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.285779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.285779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.285779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.285779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.285779] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.285779] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.285779] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.286167] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.286167] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.286167] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.286262] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.315011] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.315771] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.315771] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.315771] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.316153] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-47509eac-be17-409f-93d7-d1883311a71d taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.316410] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.316534] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.317329] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.317329] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47509eac-be17-409f-93d7-d1883311a71d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.363572] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.363783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.363850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.364165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.364444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.364611] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.364734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.364734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.364953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.365056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.365163] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c already deleted. [ 723.365298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.644311] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.644543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.644630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.645014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.645308] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.645582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.645582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.645856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.645965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.646215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.646402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.646553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.646658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.646902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.647216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.647300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.647401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.647624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.647740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.647869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.647983] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.801759] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 723.801966] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 723.802096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.820746] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.821061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.821202] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.821577] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.821821] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.822055] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 47509eac-be17-409f-93d7-d1883311a71d not found, creating... [ 723.822443] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.822618] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.822733] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.823091] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.823320] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.823768] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.823996] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.824186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.824485] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.824690] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.824880] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 47509eac-be17-409f-93d7-d1883311a71d is going to be created. [ 723.849189] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.849453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.849559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.849883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.850200] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.850495] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.048276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 in Status: SUCCESS [ 724.048559] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 deletion is rescheduled due to dependency. [ 724.048698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.148295] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: SUCCESS [ 724.148677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.151148] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 724.170963] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.171207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.171270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.171575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.171719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.172015] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.172170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.172297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.172511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.172631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.172911] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.173076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.173174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.173383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.173502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.173799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.173933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.174090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.174250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.174362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.174486] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 724.236929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.237141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.237183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.237413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.237582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.255375] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 724.565241] env[65738]: INFO networking_nsxv3.common.synchronization [req-adb4c026-d252-4112-a5df-b74a78d64092 req-c42c0262-a34e-462c-ac9a-2ca859eefcb0 service nova] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_rules [ 724.565241] env[65738]: INFO networking_nsxv3.common.synchronization [req-adb4c026-d252-4112-a5df-b74a78d64092 req-c42c0262-a34e-462c-ac9a-2ca859eefcb0 service nova] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 724.565241] env[65738]: INFO networking_nsxv3.common.synchronization [req-adb4c026-d252-4112-a5df-b74a78d64092 req-c42c0262-a34e-462c-ac9a-2ca859eefcb0 service nova] Enqueued Resource ID: 47509eac-be17-409f-93d7-d1883311a71d with Priority: HIGHEST for action port [ 724.566119] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_rules [ 724.566386] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 724.566591] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47509eac-be17-409f-93d7-d1883311a71d with Priority: HIGHEST for action port [ 724.567010] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.567270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.567364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.567626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.567707] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.568577] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.568693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.568761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.568925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.570071] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.570264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.570378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.570610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.570762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.570893] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.572493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-47509eac-be17-409f-93d7-d1883311a71d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.572694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.572819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.573079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.573213] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47509eac-be17-409f-93d7-d1883311a71d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.875021] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: SUCCESS [ 724.875440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.875637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.875859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.876218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.876452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.876574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.876763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.876986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.877191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.877383] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.075050] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.076233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.076424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.076504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47509eac-be17-409f-93d7-d1883311a71d with status ACTIVE [ 725.076668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.076867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.076867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.077062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.077141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.077367] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.077476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.077476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.077660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.077711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.078242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.078242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.078957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.079094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.079240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.079498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47509eac-be17-409f-93d7-d1883311a71d is going to be updated. [ 725.116043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.116223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.116223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.116387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.116685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.116685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47509eac-be17-409f-93d7-d1883311a71d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.381749] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.525370] env[65738]: INFO networking_nsxv3.common.synchronization [req-c8aa3fc3-6cf8-49de-88a6-04852307df74 req-fcf789e6-2b5b-4f1a-a7ca-f5bb0199326c tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 725.526435] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 725.526435] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.526435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.526797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.526797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.526797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.526964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.530773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.530773] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.582928] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.885835] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98ae3e4c-e240-4cb3-a347-31d18a23b3fa: rpc.has_security_group_logging(os_id): False [ 725.910399] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.910553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.910623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.910912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.911037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.911326] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.911448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.911523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.911685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.911759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.911879] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa is going to be created. [ 725.927897] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.928892] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.929131] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.929889] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.929889] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.930227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.930448] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.930716] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.931175] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.931477] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.932053] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.932053] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.932223] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.932434] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.932580] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.932722] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.956363] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.956442] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.956654] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.956833] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.957249] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-cc415298-8bd0-4486-8df0-bb73a7ad0daf taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.957457] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.957578] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.957966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.959855] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc415298-8bd0-4486-8df0-bb73a7ad0daf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.005347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.005837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.005837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.006073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.006374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.021872] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: IN_PROGRESS for 2s [ 726.031600] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.054400] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a68d7cc0-2683-4887-ac1a-ec2924adb796 None None] Enqueued Resource ID: 31101329-0c40-41d3-a94f-6239b17f9c00 with Priority: HIGHEST for action port [ 726.055355] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31101329-0c40-41d3-a94f-6239b17f9c00 with Priority: HIGHEST for action port [ 726.057595] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-31101329-0c40-41d3-a94f-6239b17f9c00 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.057595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31101329-0c40-41d3-a94f-6239b17f9c00" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.057595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31101329-0c40-41d3-a94f-6239b17f9c00" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.057595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31101329-0c40-41d3-a94f-6239b17f9c00" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.057595] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31101329-0c40-41d3-a94f-6239b17f9c00',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.084133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.084701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.084812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.085146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.085220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.085366] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be created. [ 726.128156] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.128328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.128444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.128711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.128960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.143313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: UNINITIALIZED for 2s [ 726.274985] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 726.275256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.463194] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.463557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.463557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.463734] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.463862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.464025] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port cc415298-8bd0-4486-8df0-bb73a7ad0daf not found, creating... [ 726.464305] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.464461] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.464650] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.464783] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.464934] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.465251] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.465405] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.465518] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.465720] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.465866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.466012] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: cc415298-8bd0-4486-8df0-bb73a7ad0daf is going to be created. [ 726.487942] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.488154] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.488278] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.488700] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.488765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.489014] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.534394] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.565233] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31101329-0c40-41d3-a94f-6239b17f9c00 [ 726.565649] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.565649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.565649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.565871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.566301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.566301] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31101329-0c40-41d3-a94f-6239b17f9c00 already deleted. [ 726.566301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31101329-0c40-41d3-a94f-6239b17f9c00" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.037547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.037670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.037985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.038191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.038354] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 727.071183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.073209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.073765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.074032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.074212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.086046] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 727.257675] env[65738]: INFO networking_nsxv3.common.synchronization [req-c8aa3fc3-6cf8-49de-88a6-04852307df74 req-954adf23-f2fa-4c8a-8127-139ab55b80d4 service nova] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_rules [ 727.257675] env[65738]: INFO networking_nsxv3.common.synchronization [req-c8aa3fc3-6cf8-49de-88a6-04852307df74 req-954adf23-f2fa-4c8a-8127-139ab55b80d4 service nova] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 727.257798] env[65738]: INFO networking_nsxv3.common.synchronization [req-c8aa3fc3-6cf8-49de-88a6-04852307df74 req-954adf23-f2fa-4c8a-8127-139ab55b80d4 service nova] Enqueued Resource ID: cc415298-8bd0-4486-8df0-bb73a7ad0daf with Priority: HIGHEST for action port [ 727.259028] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_rules [ 727.259028] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 727.259028] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc415298-8bd0-4486-8df0-bb73a7ad0daf with Priority: HIGHEST for action port [ 727.259028] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.259028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.259028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.260382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.260382] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.260625] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.260720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.261270] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc415298-8bd0-4486-8df0-bb73a7ad0daf taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.261270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.261270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.261270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.261512] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc415298-8bd0-4486-8df0-bb73a7ad0daf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.568266] env[65738]: INFO networking_nsxv3.common.synchronization [None req-352b4f7d-91bf-4f47-93aa-2026f7ce9a06 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 727.568908] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 727.570022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.570022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.570022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.572055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.572055] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.715787] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a4f1bbf5-9023-4fbb-a7f8-ddfab5c63b4d tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 727.716626] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 727.718554] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.718693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.764390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.764390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.764390] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc415298-8bd0-4486-8df0-bb73a7ad0daf with status ACTIVE [ 727.764390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.764390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.764390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.764390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.764390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.764390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.764923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.764923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.764923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.764923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.764923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.765098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.765098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.765236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.765273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.765569] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc415298-8bd0-4486-8df0-bb73a7ad0daf is going to be updated. [ 727.791237] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.791480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.791480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.791661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.791954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.792089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc415298-8bd0-4486-8df0-bb73a7ad0daf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.035761] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: SUCCESS [ 728.035761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.102959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.103364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.103591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.103776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.103902] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d already deleted. [ 728.103941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.104248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.104342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.104456] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.159952] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 728.159952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.160943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.161228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.161512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.161662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.161728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.161920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.161985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.162706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.162706] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.416996] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0f0e5391-8210-4ab2-bac8-a8d538f71927 None None] Enqueued Resource ID: 5171f996-0846-4add-9bc4-8fd41c0e0cb4 with Priority: HIGHEST for action port [ 728.418065] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5171f996-0846-4add-9bc4-8fd41c0e0cb4 with Priority: HIGHEST for action port [ 728.418065] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-5171f996-0846-4add-9bc4-8fd41c0e0cb4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.419637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5171f996-0846-4add-9bc4-8fd41c0e0cb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.419734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5171f996-0846-4add-9bc4-8fd41c0e0cb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.420426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5171f996-0846-4add-9bc4-8fd41c0e0cb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.420426] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5171f996-0846-4add-9bc4-8fd41c0e0cb4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.629021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.629021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.629021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.629021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.629021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.629021] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d already deleted. [ 728.629021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.667026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.667026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.667026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.667026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.667026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.667703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.667703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.667703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.667703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.667703] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.922911] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5171f996-0846-4add-9bc4-8fd41c0e0cb4 [ 728.923174] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.923303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.923406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.923661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.923756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.923854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5171f996-0846-4add-9bc4-8fd41c0e0cb4 already deleted. [ 728.923936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5171f996-0846-4add-9bc4-8fd41c0e0cb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.101869] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 729.102414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.102697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.103095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.105402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.105609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.106393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.106563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.106723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.108418] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.171025] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c141272-ba24-462d-b6ed-4f263864d60c: rpc.has_security_group_logging(os_id): False [ 729.192141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.192301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.192398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.192628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.192717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.192911] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.193039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.193113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.193271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.193356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.193577] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.193689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.193739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.193878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.196531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.197923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.198068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.198136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.198343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.198431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.198507] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be created. [ 729.302885] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.302885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.302885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.303107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.303214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.325020] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 729.393562] env[65738]: INFO networking_nsxv3.common.synchronization [req-c623f5a1-070e-4ec7-9af5-2ee12fc7b5f3 req-f663b90f-f9fb-4f6f-bf60-805e682ca322 tempest-ServerRescueTestJSON-1769012266 tempest-ServerRescueTestJSON-1769012266-project-member] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 729.395118] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 729.395118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.395118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.395118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.395672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.395840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.395959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.396061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.396226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.396308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.396406] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.610176] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.900595] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.924774] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.925038] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.925224] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.925572] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.925894] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.926142] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.926307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.926569] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.926758] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.927050] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.927211] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.927347] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.927513] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.927783] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.927950] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.928141] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.950870] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.951110] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.951784] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.951784] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-506" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.951882] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-d07961e3-1482-451c-b27f-39861db7d2f3 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.952063] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.952455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.952884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.953073] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d07961e3-1482-451c-b27f-39861db7d2f3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.113594] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.407681] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.457020] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.457307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.457457] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.457912] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.458114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.458285] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port d07961e3-1482-451c-b27f-39861db7d2f3 not found, creating... [ 730.458707] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.459537] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.459739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.460107] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.460319] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.460686] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.460854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.461017] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.466207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.466207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.466207] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: d07961e3-1482-451c-b27f-39861db7d2f3 is going to be created. [ 730.490776] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.491025] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.491233] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.491553] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.491870] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.492581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.518534] env[65738]: INFO networking_nsxv3.common.synchronization [req-1bb11a50-36fc-4325-ad8d-2cfc90897db3 req-265c52f0-dfde-40d6-9ce9-d1222fbd8401 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 730.518534] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 730.518534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.518742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.518742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.518898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.519103] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.519163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.519220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.519393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.519441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.519539] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.616319] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.616493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.616619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.616759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.616985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.616985] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 730.671954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.671954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.671954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.671954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.672324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.685691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 730.908844] env[65738]: INFO networking_nsxv3.common.synchronization [req-6855cb52-beda-43c0-bfb9-96a623740968 req-ad5b5a55-62b1-485a-8fb1-72cf0c3cff80 tempest-InstanceActionsTestJSON-346229597 tempest-InstanceActionsTestJSON-346229597-project-member] Enqueued Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 730.909673] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGHEST for action security_group_members [ 730.909780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.910126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.910126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.910584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.910676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.910773] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be updated. [ 730.911964] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.912099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.912190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.912357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.913083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.913736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.913736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.913736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.913736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.913900] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.969276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.970239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.970409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.970655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.970816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.991806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 731.021511] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.021905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.021905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.022019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.022121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.022364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.022526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.022573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.023019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.023019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.023019] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 731.101099] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.101350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.101350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.101529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.101673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.112576] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 731.306456] env[65738]: INFO networking_nsxv3.common.synchronization [req-c623f5a1-070e-4ec7-9af5-2ee12fc7b5f3 req-4d6fab7d-1083-4dae-ab8a-ccbe2a9137e0 service nova] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_rules [ 731.306717] env[65738]: INFO networking_nsxv3.common.synchronization [req-c623f5a1-070e-4ec7-9af5-2ee12fc7b5f3 req-4d6fab7d-1083-4dae-ab8a-ccbe2a9137e0 service nova] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 731.306914] env[65738]: INFO networking_nsxv3.common.synchronization [req-c623f5a1-070e-4ec7-9af5-2ee12fc7b5f3 req-4d6fab7d-1083-4dae-ab8a-ccbe2a9137e0 service nova] Enqueued Resource ID: d07961e3-1482-451c-b27f-39861db7d2f3 with Priority: HIGHEST for action port [ 731.307779] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_rules [ 731.307965] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 731.308132] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d07961e3-1482-451c-b27f-39861db7d2f3 with Priority: HIGHEST for action port [ 731.308681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.308681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.308853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.309054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.309167] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.310765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.310919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.311297] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d07961e3-1482-451c-b27f-39861db7d2f3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.311465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.311570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.311866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.311998] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d07961e3-1482-451c-b27f-39861db7d2f3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.343841] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 731.344119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.417249] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.417249] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.417249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.418170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.418170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.418170] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 is going to be updated. [ 731.461900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.461900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.461900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.462078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.462241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.480889] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: IN_PROGRESS for 2s [ 731.814200] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.814500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.815707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d07961e3-1482-451c-b27f-39861db7d2f3 with status ACTIVE [ 731.815946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.816065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.816163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.816434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.816434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.816712] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.816712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.816848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.816915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.816990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.817194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.817289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.817350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.817487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.817561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.817645] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d07961e3-1482-451c-b27f-39861db7d2f3 is going to be updated. [ 731.864904] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.865081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.865155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.865401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.865556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.865827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d07961e3-1482-451c-b27f-39861db7d2f3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.697580] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 732.697975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.698041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.699655] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.699655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.699655] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.003056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 733.003291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.003490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.003766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.003961] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.004095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.004160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.004322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.004394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.004490] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.124647] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 733.124647] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 733.124647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.201364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.201567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.201653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.201889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.202490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.202490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.202490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.203053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.203203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.203375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.203578] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.203758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.204102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.204102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.204239] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.204304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.204368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.204556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.204673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.204808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.204968] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.491230] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 in Status: SUCCESS [ 733.491511] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 deletion is rescheduled due to dependency. [ 733.491695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.507315] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.514190] env[65738]: INFO networking_nsxv3.common.synchronization [req-a7e1d47a-91ee-4a9f-9a4d-fd34c98a63e9 req-3d23fa78-9031-40f3-8326-b920fb265ae8 tempest-ServerAddressesTestJSON-611518769 tempest-ServerAddressesTestJSON-611518769-project-member] Enqueued Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 733.514772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 733.517245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.517245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.517245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.517245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.517245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.517245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.517245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.517557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.517557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.517557] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.710387] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e974415d-6bf2-41ac-b8e6-2817575b8abd: rpc.has_security_group_logging(os_id): False [ 733.734542] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.734894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.735098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.735611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.735821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.736380] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.736723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.736976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.737335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.737581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.738072] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.738357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.738508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.738799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.738972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.740497] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.740497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.740497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.740497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.741823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.741823] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 733.817187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.817187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.817187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.817187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.817187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.830898] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 733.956891] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.957374] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-924" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.957595] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-924" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.958045] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-924" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.958467] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.958803] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.958977] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.959307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.959508] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.959800] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.959961] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.960199] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.960371] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.961640] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.961640] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.961995] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.983276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.983750] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.983750] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.983871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-924" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.984280] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-db8996b9-0815-4a10-901f-405dac255550 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.984280] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.984475] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.984867] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.984938] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8996b9-0815-4a10-901f-405dac255550',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.013411] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.021031] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.021031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.021031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.021373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.021567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.021667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.021730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.021978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.022077] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 already deleted. [ 734.022166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.489922] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.490166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.490270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.490532] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.490655] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.490813] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port db8996b9-0815-4a10-901f-405dac255550 not found, creating... [ 734.491096] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.492687] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.492687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.493105] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: db8996b9-0815-4a10-901f-405dac255550 is going to be created. [ 734.517325] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.517646] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.517733] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.518023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.518291] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.518511] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.519580] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.519752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.519855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.519963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.520097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.520186] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be updated. [ 734.561616] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.561944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.561944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.562135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.562295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.573157] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 735.196024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a7e1d47a-91ee-4a9f-9a4d-fd34c98a63e9 req-f2e45b95-77e2-44bb-bbf4-d07226b0d1cf service nova] Enqueued Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_rules [ 735.196024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a7e1d47a-91ee-4a9f-9a4d-fd34c98a63e9 req-f2e45b95-77e2-44bb-bbf4-d07226b0d1cf service nova] Enqueued Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 735.196024] env[65738]: INFO networking_nsxv3.common.synchronization [req-a7e1d47a-91ee-4a9f-9a4d-fd34c98a63e9 req-f2e45b95-77e2-44bb-bbf4-d07226b0d1cf service nova] Enqueued Resource ID: db8996b9-0815-4a10-901f-405dac255550 with Priority: HIGHEST for action port [ 735.196580] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_rules [ 735.196730] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 735.196825] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8996b9-0815-4a10-901f-405dac255550 with Priority: HIGHEST for action port [ 735.200023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.200023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.200023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.200023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.200023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.200798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.204559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8996b9-0815-4a10-901f-405dac255550 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.204640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.205265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.205265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.205265] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8996b9-0815-4a10-901f-405dac255550',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.707521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.707666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.707877] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.708958] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db8996b9-0815-4a10-901f-405dac255550 with status ACTIVE [ 735.708958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.709191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.709191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.709614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.709614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.709614] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.709614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.709746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.713219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.713219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.713219] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db8996b9-0815-4a10-901f-405dac255550 is going to be updated. [ 735.737274] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.737482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.737482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.737698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.737833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.738734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8996b9-0815-4a10-901f-405dac255550" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.845191] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 735.845773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.134031] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c8349ce1-e44c-4fc6-ab3f-712033f6c700 None None] Enqueued Resource ID: a9caa6e4-4009-4b4c-a3f6-29fb2474b11a with Priority: HIGHEST for action port [ 736.134031] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9caa6e4-4009-4b4c-a3f6-29fb2474b11a with Priority: HIGHEST for action port [ 736.135148] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9caa6e4-4009-4b4c-a3f6-29fb2474b11a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.135598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9caa6e4-4009-4b4c-a3f6-29fb2474b11a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.135598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9caa6e4-4009-4b4c-a3f6-29fb2474b11a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.135887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9caa6e4-4009-4b4c-a3f6-29fb2474b11a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.135972] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9caa6e4-4009-4b4c-a3f6-29fb2474b11a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.216745] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.585915] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 736.586145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.586325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.586549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.586799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.587072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.587072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.587199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.587277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.587362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.587454] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.639210] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9caa6e4-4009-4b4c-a3f6-29fb2474b11a [ 736.639210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.639600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.639600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.639950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.639950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.640194] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9caa6e4-4009-4b4c-a3f6-29fb2474b11a already deleted. [ 736.640243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9caa6e4-4009-4b4c-a3f6-29fb2474b11a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.723283] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.723283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.723283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.723283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.723283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.723283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 is going to be created. [ 736.759886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.759886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.759886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.759886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.759886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.776234] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: UNINITIALIZED for 2s [ 736.850551] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e101dee5-c25c-4038-a7cf-a88a4c3dcc4b None None] Enqueued Resource ID: e9f67eb2-0497-45ec-a2b7-d7142d1aba31 with Priority: HIGHEST for action port [ 736.850551] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f67eb2-0497-45ec-a2b7-d7142d1aba31 with Priority: HIGHEST for action port [ 736.850551] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9f67eb2-0497-45ec-a2b7-d7142d1aba31 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.850551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9f67eb2-0497-45ec-a2b7-d7142d1aba31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.850551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9f67eb2-0497-45ec-a2b7-d7142d1aba31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.850551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9f67eb2-0497-45ec-a2b7-d7142d1aba31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.850551] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9f67eb2-0497-45ec-a2b7-d7142d1aba31',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.093545] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.093769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.093769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.094588] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.094588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.094870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.094870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.094870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.095255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.095458] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.096678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.096865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.096938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.097036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097224] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.355430] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9f67eb2-0497-45ec-a2b7-d7142d1aba31 [ 737.355747] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.355813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.355910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.356138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.356239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.356351] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9f67eb2-0497-45ec-a2b7-d7142d1aba31 already deleted. [ 737.356436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9f67eb2-0497-45ec-a2b7-d7142d1aba31" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.604288] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33ab54d8-f174-4187-9e64-2cd39cd90273: rpc.has_security_group_logging(os_id): False [ 737.624386] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.624506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.624560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.624768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.625111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.625343] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.625471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.625544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.625678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.625785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.625942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.626082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.626145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.626254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.626328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.626521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.626605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.627269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.627381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.627381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.627503] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be updated. [ 737.709453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.711899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.711899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.711899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.711899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.725125] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 738.789668] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: SUCCESS [ 738.790373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.790373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.790373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.790657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.790657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.790657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.790798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.790828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.790901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.791128] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.975682] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6dc7d3ff-1802-4d78-a590-ad33135dc6b6 None None] Enqueued Resource ID: ef89558b-a916-4337-abaf-963e9ba69c7b with Priority: HIGHEST for action port [ 738.976529] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef89558b-a916-4337-abaf-963e9ba69c7b with Priority: HIGHEST for action port [ 738.976912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef89558b-a916-4337-abaf-963e9ba69c7b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.977059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef89558b-a916-4337-abaf-963e9ba69c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.977144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef89558b-a916-4337-abaf-963e9ba69c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.977441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef89558b-a916-4337-abaf-963e9ba69c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.977542] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef89558b-a916-4337-abaf-963e9ba69c7b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.207259] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9822f553-0f8f-48df-87a2-631cd48604b4 None None] Enqueued Resource ID: 3192c2d5-dc2f-4dc8-99c0-efdf574ef484 with Priority: HIGHEST for action port [ 739.207945] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3192c2d5-dc2f-4dc8-99c0-efdf574ef484 with Priority: HIGHEST for action port [ 739.208174] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-3192c2d5-dc2f-4dc8-99c0-efdf574ef484 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.208346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3192c2d5-dc2f-4dc8-99c0-efdf574ef484" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.208420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3192c2d5-dc2f-4dc8-99c0-efdf574ef484" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.208766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3192c2d5-dc2f-4dc8-99c0-efdf574ef484" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.208766] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3192c2d5-dc2f-4dc8-99c0-efdf574ef484',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.296489] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.296489] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.296489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.297308] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.297308] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.297308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.297736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.297736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.297736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.297736] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.479987] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef89558b-a916-4337-abaf-963e9ba69c7b [ 739.479987] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.480193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.480193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.481036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.481036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.481206] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef89558b-a916-4337-abaf-963e9ba69c7b already deleted. [ 739.481206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef89558b-a916-4337-abaf-963e9ba69c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.711469] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3192c2d5-dc2f-4dc8-99c0-efdf574ef484 [ 739.711469] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.711469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.711469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.711855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.711855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.711912] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3192c2d5-dc2f-4dc8-99c0-efdf574ef484 already deleted. [ 739.712159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3192c2d5-dc2f-4dc8-99c0-efdf574ef484" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.747052] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 739.747340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.801319] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b5f20e7-94a1-4514-adde-54a6960390c3: rpc.has_security_group_logging(os_id): False [ 739.826157] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.827576] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.827576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.827854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.828457] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.828607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.828668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.829361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.829490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.829735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.829903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.829978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.830098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.830177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.830610] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 is going to be created. [ 739.916040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.916306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.916306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.916491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.916712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.931534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: IN_PROGRESS for 2s [ 740.178506] env[65738]: INFO networking_nsxv3.common.synchronization [req-f0d4940a-7689-4a10-b650-423879a7dd04 req-e2310a48-ea31-407f-acd9-c471d53410e1 tempest-ServerGroupTestJSON-328494103 tempest-ServerGroupTestJSON-328494103-project-member] Enqueued Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 740.178506] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 740.178506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.178506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.178506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.183154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.183451] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.183603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.183694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.183911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.184010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.184144] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.630174] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.630398] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-84" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.630529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-84" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.631050] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-84" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.631344] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.631509] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.631644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.631871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.632044] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.632306] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.632543] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.632646] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.632870] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.633109] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.633265] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.633465] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.654826] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.655038] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.657096] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.657096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-84" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.657096] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.657096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.657096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.657096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.657096] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f820ce12-11b3-4bbc-b4a9-bec1bf52e3da',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.687206] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.687206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.687206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.687500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.687543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.687724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.687925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.687925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.688778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.688778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.688778] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 already deleted. [ 740.688778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.160049] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.160049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.160049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.160427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.160427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.160578] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port f820ce12-11b3-4bbc-b4a9-bec1bf52e3da not found, creating... [ 741.160922] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.161173] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.161242] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.161424] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.161553] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.161841] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.161990] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.162114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.162323] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.162452] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.162686] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: f820ce12-11b3-4bbc-b4a9-bec1bf52e3da is going to be created. [ 741.183668] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.183843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.183942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.184267] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.184505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.184736] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.944476] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: SUCCESS [ 741.944728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.005869] env[65738]: INFO networking_nsxv3.common.synchronization [req-f0d4940a-7689-4a10-b650-423879a7dd04 req-e24446bb-9ca8-42e0-b05a-afbc3070a868 service nova] Enqueued Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_rules [ 742.006520] env[65738]: INFO networking_nsxv3.common.synchronization [req-f0d4940a-7689-4a10-b650-423879a7dd04 req-e24446bb-9ca8-42e0-b05a-afbc3070a868 service nova] Enqueued Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 742.006520] env[65738]: INFO networking_nsxv3.common.synchronization [req-f0d4940a-7689-4a10-b650-423879a7dd04 req-e24446bb-9ca8-42e0-b05a-afbc3070a868 service nova] Enqueued Resource ID: f820ce12-11b3-4bbc-b4a9-bec1bf52e3da with Priority: HIGHEST for action port [ 742.006834] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_rules [ 742.006948] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 742.007058] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f820ce12-11b3-4bbc-b4a9-bec1bf52e3da with Priority: HIGHEST for action port [ 742.007433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.007604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.007689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.007969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.008101] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.012195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.012195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.012195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.012195] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.012195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.013311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.013728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.014357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.014470] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f820ce12-11b3-4bbc-b4a9-bec1bf52e3da',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.516938] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.517300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.517300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.517493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f820ce12-11b3-4bbc-b4a9-bec1bf52e3da with status ACTIVE [ 742.517601] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.517723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.518182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.518395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.518500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.518865] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.519056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.519056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.519258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.519322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.519560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.521597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.521597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.521597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.521597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.521597] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f820ce12-11b3-4bbc-b4a9-bec1bf52e3da is going to be updated. [ 742.551051] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.551051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.551051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.551051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.551051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.551051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f820ce12-11b3-4bbc-b4a9-bec1bf52e3da" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.022567] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.165704] env[65738]: INFO networking_nsxv3.common.synchronization [req-05a3235b-8475-4d28-8338-651de28634ba req-32b87211-aba6-4a97-accb-1d0fc440495d tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 743.169890] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 743.171060] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.171060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.171060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.171060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.171060] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.171060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.171785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.171785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.171785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.171785] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.527992] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.528354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.528354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.528488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.528576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.528674] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 is going to be created. [ 743.558218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.558218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.558218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.558653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.558898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.578064] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: UNINITIALIZED for 2s [ 743.674179] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.674411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.674411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.674779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.674779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.675081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.675081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.675228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.675284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.675355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.675411] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 already deleted. [ 743.675516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.844205] env[65738]: INFO networking_nsxv3.common.synchronization [req-229e7253-282a-452d-b034-cca06150dfbf req-613692fc-77cb-4a2d-a6d0-f498f2dc20b2 tempest-ServerMetadataTestJSON-118508465 tempest-ServerMetadataTestJSON-118508465-project-member] Enqueued Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 743.844455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGHEST for action security_group_members [ 743.844763] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.844928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.844977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.845664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.847870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.848023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.848069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.848238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.848331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.848429] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.986206] env[65738]: INFO networking_nsxv3.common.synchronization [None req-aacded8c-4d28-46f4-8bc4-9f494d808260 None None] Enqueued Resource ID: cfbab466-16c9-42ae-b2cd-50c5e1f0d09e with Priority: HIGHEST for action port [ 743.986206] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfbab466-16c9-42ae-b2cd-50c5e1f0d09e with Priority: HIGHEST for action port [ 743.986601] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfbab466-16c9-42ae-b2cd-50c5e1f0d09e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.986876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfbab466-16c9-42ae-b2cd-50c5e1f0d09e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.987082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfbab466-16c9-42ae-b2cd-50c5e1f0d09e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.987458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfbab466-16c9-42ae-b2cd-50c5e1f0d09e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.987667] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfbab466-16c9-42ae-b2cd-50c5e1f0d09e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.202874] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.203148] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-556" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.203357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-556" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.203806] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-556" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.204080] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.204262] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.204405] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.204630] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.205884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.206052] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.206152] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.206251] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.206336] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.206470] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.206555] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.206637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.227392] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.227660] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.227716] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.227855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-556" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.228696] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-9dc27a62-49d2-4737-83ce-9336a2777b88 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.228696] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.228696] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.228891] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.229079] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc27a62-49d2-4737-83ce-9336a2777b88',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.350927] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.351143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.351236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.351403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.351494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.351702] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.351799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.351862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.352028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.352108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.352198] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f is going to be updated. [ 744.382512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.382764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.382764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.382981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.383115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.393156] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: IN_PROGRESS for 2s [ 744.492548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfbab466-16c9-42ae-b2cd-50c5e1f0d09e [ 744.492880] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.493031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.493094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.493314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.493405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.493498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfbab466-16c9-42ae-b2cd-50c5e1f0d09e already deleted. [ 744.493582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfbab466-16c9-42ae-b2cd-50c5e1f0d09e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.732134] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.732134] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.737472] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 9dc27a62-49d2-4737-83ce-9336a2777b88 not found, creating... [ 744.737472] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.737472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.737472] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.737805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.737805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.737805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.737805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.737805] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 is going to be created. [ 744.757177] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.757389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.757505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.757945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.758187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.758455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.552538] env[65738]: INFO networking_nsxv3.common.synchronization [req-05a3235b-8475-4d28-8338-651de28634ba req-f3879ac1-b482-4239-871b-2460fe89f5c6 service nova] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 745.552772] env[65738]: INFO networking_nsxv3.common.synchronization [req-05a3235b-8475-4d28-8338-651de28634ba req-f3879ac1-b482-4239-871b-2460fe89f5c6 service nova] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 745.552926] env[65738]: INFO networking_nsxv3.common.synchronization [req-05a3235b-8475-4d28-8338-651de28634ba req-f3879ac1-b482-4239-871b-2460fe89f5c6 service nova] Enqueued Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 745.553173] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 745.553293] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 745.553385] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 745.553955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.556563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.556638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.556917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557025] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.558154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.558285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.558343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.558516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561307] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.561307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.561307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.561307] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.565052] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc27a62-49d2-4737-83ce-9336a2777b88 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.565052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.565052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.565052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.565414] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc27a62-49d2-4737-83ce-9336a2777b88',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.592960] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: SUCCESS [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.592960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.592960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.592960] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.843664] env[65738]: INFO networking_nsxv3.common.synchronization [req-fd89b03e-f360-4705-8d92-f2fde0bc92d0 req-77c2d78e-c10c-4aad-927e-d456ac1bbad4 tempest-ServersTestBootFromVolume-696029730 tempest-ServersTestBootFromVolume-696029730-project-member] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 745.843912] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 745.845445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.845445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.845445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.845445] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.067887] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.069259] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.069445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.069916] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dc27a62-49d2-4737-83ce-9336a2777b88 with status ACTIVE [ 746.069916] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.071227] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.071227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.073370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.073498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.073588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.075533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.075533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.075533] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 is going to be updated. [ 746.095363] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.095363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.095363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.097190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.097359] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.097509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.097561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.097744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.097835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.097981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.098809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.098809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.098809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.098809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.098809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.099651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.099769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.099947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.100284] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.103808] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.104496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.104496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.105755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.105940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.106156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.227534] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.228220] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-945" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.229323] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-945" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.229323] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-945" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.229323] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.229508] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.229652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.229913] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.230302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.230566] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.230676] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.230984] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.231132] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.231249] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.232046] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.232252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.256450] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.256616] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.256755] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.256929] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-945" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.257284] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-6325ec6f-c4bb-446f-a1f7-86951b633b1a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.257516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.257516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.257917] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.258044] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6325ec6f-c4bb-446f-a1f7-86951b633b1a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.349121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.349321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.349375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.349619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.349723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.349932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.350087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.350161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.350278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.350352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.350434] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 already deleted. [ 746.350521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.406518] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f in Status: SUCCESS [ 746.406722] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f deletion is rescheduled due to dependency. [ 746.406838] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.576282] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.604142] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f52ce15c-4ac3-4674-a5de-8f724e639079: rpc.has_security_group_logging(os_id): False [ 746.622907] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.623091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.623132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.623352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.623434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.623645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.623762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.623966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.624046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.624098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.624248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.624334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.624383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.624542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.624592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.624772] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.624847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.625046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.625046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.625149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.625218] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 is going to be created. [ 746.692661] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.692904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.692979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.693248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.693448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.707199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: IN_PROGRESS for 2s [ 746.711708] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d38ae559-ed55-480c-bec3-70b9b34e1372 None None] Enqueued Resource ID: 03f12b91-8a6e-4be9-adad-cc6c6358e75c with Priority: HIGHEST for action port [ 746.712430] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f12b91-8a6e-4be9-adad-cc6c6358e75c with Priority: HIGHEST for action port [ 746.712776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f12b91-8a6e-4be9-adad-cc6c6358e75c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.712974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f12b91-8a6e-4be9-adad-cc6c6358e75c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.712974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f12b91-8a6e-4be9-adad-cc6c6358e75c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.713257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f12b91-8a6e-4be9-adad-cc6c6358e75c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.713338] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f12b91-8a6e-4be9-adad-cc6c6358e75c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.760882] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.761131] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.761245] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.761530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.761707] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.761920] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 6325ec6f-c4bb-446f-a1f7-86951b633b1a not found, creating... [ 746.762316] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.762486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.762733] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.762882] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.762976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.763312] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.763493] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.763604] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.763819] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.763947] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.764098] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 6325ec6f-c4bb-446f-a1f7-86951b633b1a is going to be created. [ 746.803535] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.803778] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.803915] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.804215] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.804449] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.805664] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.079094] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.079404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.079404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.079629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.079762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.079819] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be created. [ 747.104693] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.104940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.105031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.105296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.105461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.115267] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: UNINITIALIZED for 2s [ 747.215795] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03f12b91-8a6e-4be9-adad-cc6c6358e75c [ 747.216043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.216175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.216246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.216467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.216558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.216651] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03f12b91-8a6e-4be9-adad-cc6c6358e75c already deleted. [ 747.216811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f12b91-8a6e-4be9-adad-cc6c6358e75c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.490650] env[65738]: INFO networking_nsxv3.common.synchronization [req-fd89b03e-f360-4705-8d92-f2fde0bc92d0 req-a98497f3-295f-4f37-8e3f-5334e3cbc2ce service nova] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 747.490934] env[65738]: INFO networking_nsxv3.common.synchronization [req-fd89b03e-f360-4705-8d92-f2fde0bc92d0 req-a98497f3-295f-4f37-8e3f-5334e3cbc2ce service nova] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 747.490934] env[65738]: INFO networking_nsxv3.common.synchronization [req-fd89b03e-f360-4705-8d92-f2fde0bc92d0 req-a98497f3-295f-4f37-8e3f-5334e3cbc2ce service nova] Enqueued Resource ID: 6325ec6f-c4bb-446f-a1f7-86951b633b1a with Priority: HIGHEST for action port [ 747.491194] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_rules [ 747.491347] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 747.491415] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6325ec6f-c4bb-446f-a1f7-86951b633b1a with Priority: HIGHEST for action port [ 747.491957] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.493682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.493682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.493924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.493968] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.494866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.495027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.495115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.495788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.497533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.497533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.497533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.497533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.497533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.497533] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.497533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6325ec6f-c4bb-446f-a1f7-86951b633b1a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.497959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.497959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.497959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.497959] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6325ec6f-c4bb-446f-a1f7-86951b633b1a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.000523] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.003729] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.004096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.004096] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6325ec6f-c4bb-446f-a1f7-86951b633b1a with status ACTIVE [ 748.004538] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.004538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.004538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.004844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.004844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.005176] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.005333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.005432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.006741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.007038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.007295] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.007408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.007648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.007648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.007999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.008188] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6325ec6f-c4bb-446f-a1f7-86951b633b1a is going to be updated. [ 748.036234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.036435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.036639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.036861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.038470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.038470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6325ec6f-c4bb-446f-a1f7-86951b633b1a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.184343] env[65738]: INFO networking_nsxv3.common.synchronization [None req-07a4546c-177f-4741-bfa0-e61607468c7c None None] Enqueued Resource ID: a0847727-bf59-4e9f-8b48-2dbd4a8cb94c with Priority: HIGHEST for action port [ 748.185355] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0847727-bf59-4e9f-8b48-2dbd4a8cb94c with Priority: HIGHEST for action port [ 748.185355] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0847727-bf59-4e9f-8b48-2dbd4a8cb94c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.185503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0847727-bf59-4e9f-8b48-2dbd4a8cb94c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.185503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0847727-bf59-4e9f-8b48-2dbd4a8cb94c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.185727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0847727-bf59-4e9f-8b48-2dbd4a8cb94c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.185862] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0847727-bf59-4e9f-8b48-2dbd4a8cb94c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.512178] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.692037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0847727-bf59-4e9f-8b48-2dbd4a8cb94c [ 748.692374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.692572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.692720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.693042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.693170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.693294] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0847727-bf59-4e9f-8b48-2dbd4a8cb94c already deleted. [ 748.693417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0847727-bf59-4e9f-8b48-2dbd4a8cb94c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.723377] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: SUCCESS [ 748.723377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.013266] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.013482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.013565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.013791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.013871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.013967] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 is going to be created. [ 749.054930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.055142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.055231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.055493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.055697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.073457] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: UNINITIALIZED for 2s [ 749.130598] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.130598] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.130598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.130598] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.634499] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.138032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72af6c3f-606c-49b1-8ed2-d3711bffee90: rpc.has_security_group_logging(os_id): False [ 750.157999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.158184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.158257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.158477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.158580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.159971] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.159971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.159971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.159971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.159971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.159971] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be created. [ 750.233455] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.234032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.234032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.234282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.235383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.255490] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 751.063314] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5984e63a-98d8-40bf-a4ea-947588735aa4 None None] Enqueued Resource ID: 64386153-199d-427b-8ff6-469077cec56c with Priority: HIGHEST for action port [ 751.063989] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64386153-199d-427b-8ff6-469077cec56c with Priority: HIGHEST for action port [ 751.064334] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-64386153-199d-427b-8ff6-469077cec56c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.064797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64386153-199d-427b-8ff6-469077cec56c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.064797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64386153-199d-427b-8ff6-469077cec56c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.064797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64386153-199d-427b-8ff6-469077cec56c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.064990] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64386153-199d-427b-8ff6-469077cec56c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.085978] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: SUCCESS [ 751.086256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.086392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.086604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.086797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.086913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.086980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.087147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.087228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.087313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.087404] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.569049] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64386153-199d-427b-8ff6-469077cec56c [ 751.569354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.569513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.569613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.569897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.570110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.570220] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64386153-199d-427b-8ff6-469077cec56c already deleted. [ 751.570359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64386153-199d-427b-8ff6-469077cec56c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.590895] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.880977] env[65738]: INFO networking_nsxv3.common.synchronization [req-7766a8ea-94f4-4eab-bc78-b2a3b79ba0ba req-d8e1d4db-eaa7-432a-ae86-e253d81008cb tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 751.880977] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 751.881408] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.881408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.881685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.881685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.881842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.881965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.882037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.882208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.882302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.882396] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.094444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fb1ec78-dd9a-4648-b8b0-a049555e5a46: rpc.has_security_group_logging(os_id): False [ 752.114258] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.114380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.114421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.114614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.114708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.114953] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.115068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.115132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.115280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.115354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.115439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 is going to be created. [ 752.181487] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.181689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.181773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.182091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.182310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.195865] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: IN_PROGRESS for 2s [ 752.277351] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 752.277582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.384197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.384343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.384392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.384574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.384667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.384862] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.384961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.385035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.385395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.385395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.385395] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 752.417667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.417878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.417927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.418159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.418317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.428231] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 754.089165] env[65738]: INFO networking_nsxv3.common.synchronization [req-e7b2a6bf-d522-4d50-9f6f-e29a6f1ea20b req-50fa3bf6-609b-4fae-b4f8-903ad5074383 tempest-ServerAddressesTestJSON-611518769 tempest-ServerAddressesTestJSON-611518769-project-member] Enqueued Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 754.089785] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGHEST for action security_group_members [ 754.091136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.091136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.091136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.091136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.091136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.091477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.091477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.091477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.091574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.091661] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.213953] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: SUCCESS [ 754.214224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.442613] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 754.442613] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 754.442613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.595040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.595040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.595040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.595256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.595356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.595547] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.595656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.595719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.595868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.595944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.597422] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 is going to be updated. [ 754.632738] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.633019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.633105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.633351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.633491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.645788] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: IN_PROGRESS for 2s [ 756.658620] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 in Status: SUCCESS [ 756.658900] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 deletion is rescheduled due to dependency. [ 756.658900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.766101] env[65738]: INFO networking_nsxv3.common.synchronization [req-10c7000e-9224-4f42-a2f2-063848a236e3 req-d938ce8d-a7b5-4d21-adbe-221d297d7379 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 756.770491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 756.770900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.771657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.771657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.771657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.771657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.771657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.771907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.771907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.771968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.772121] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.274149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.274503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.274620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.274925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.274999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.275298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.275445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.275526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.275700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.275877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.275993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 757.309557] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.309774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.309852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.310103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.310291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.320905] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 757.688237] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.688766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.688766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.688910] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.689202] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.689401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.689504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.689759] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.689876] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.693018] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.693018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.693018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.693018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.693018] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.693018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.693018] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.714038] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.714710] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.714710] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.715254] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.716228] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-6d09e3f7-144d-402d-9072-606e706dbdb8 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.716228] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.716228] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.716598] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.716828] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d09e3f7-144d-402d-9072-606e706dbdb8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.184376] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7290f219-b8ca-466e-a518-743e14f4aef6 None None] Enqueued Resource ID: 8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6 with Priority: HIGHEST for action port [ 758.184935] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6 with Priority: HIGHEST for action port [ 758.185294] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.185419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.185472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.185716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.185798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.220119] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.220310] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.220420] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.220670] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.220812] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.221374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 6d09e3f7-144d-402d-9072-606e706dbdb8 not found, creating... [ 758.221374] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.221565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.221613] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.221909] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.221909] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.222210] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.222756] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.222756] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.222756] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.222888] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.223085] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 6d09e3f7-144d-402d-9072-606e706dbdb8 is going to be created. [ 758.244716] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.244941] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.245096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.245432] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.245670] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.245926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.691629] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6 [ 758.691629] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.691629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.691629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.691629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.691629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.691629] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6 already deleted. [ 758.691629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f2dd831-d878-4ea6-a3d2-bb34bd6bfff6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.948971] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fb77103-8bd0-4f4e-bd63-c367d7e082be req-05ff42a6-8173-4069-8586-f2e6e166fefe tempest-ServerGroupTestJSON-328494103 tempest-ServerGroupTestJSON-328494103-project-member] Enqueued Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 758.949637] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGHEST for action security_group_members [ 758.950019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.950318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.950410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.950670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.950881] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.951056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.951167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.951297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.951408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.951534] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.981616] env[65738]: INFO networking_nsxv3.common.synchronization [req-10c7000e-9224-4f42-a2f2-063848a236e3 req-b785889d-96d3-454e-9ee8-8ceef7e5a493 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 758.981859] env[65738]: INFO networking_nsxv3.common.synchronization [req-10c7000e-9224-4f42-a2f2-063848a236e3 req-b785889d-96d3-454e-9ee8-8ceef7e5a493 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 758.982016] env[65738]: INFO networking_nsxv3.common.synchronization [req-10c7000e-9224-4f42-a2f2-063848a236e3 req-b785889d-96d3-454e-9ee8-8ceef7e5a493 service nova] Enqueued Resource ID: 6d09e3f7-144d-402d-9072-606e706dbdb8 with Priority: HIGHEST for action port [ 758.983961] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 758.983961] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 758.983961] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d09e3f7-144d-402d-9072-606e706dbdb8 with Priority: HIGHEST for action port [ 758.984253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.984253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.984338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.984552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.984636] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.986356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.986356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.986356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d09e3f7-144d-402d-9072-606e706dbdb8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.986356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.986356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.986861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.986861] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d09e3f7-144d-402d-9072-606e706dbdb8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.331065] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 759.331065] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 759.331168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.331939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.331939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.331939] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.332127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.332127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.332263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.332340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.332436] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.454299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.454448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.454585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.454750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.454839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.455078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.455215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.455215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.455369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.455452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.455566] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 is going to be updated. [ 759.486349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.486644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.486644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.486792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.486912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.488043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.488154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.490833] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d09e3f7-144d-402d-9072-606e706dbdb8 with status ACTIVE [ 759.490935] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.491060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.491317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.491317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.491517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.491548] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.491632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.491691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.491834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.491910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.492275] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.492275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.493411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.493411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.493411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.493411] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d09e3f7-144d-402d-9072-606e706dbdb8 is going to be updated. [ 759.504412] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: IN_PROGRESS for 2s [ 759.516499] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.516627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.516760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.518271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.518271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.518271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d09e3f7-144d-402d-9072-606e706dbdb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.835371] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.937794] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 759.937921] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:1 started [ 760.337982] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.558940] env[65738]: INFO networking_nsxv3.common.synchronization [None req-14c43fd6-e500-4582-8ef5-d80c129ac79b None None] Enqueued Resource ID: 99549646-eaa5-423b-888a-66a9cb535f4a with Priority: HIGHEST for action port [ 760.559226] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99549646-eaa5-423b-888a-66a9cb535f4a with Priority: HIGHEST for action port [ 760.559800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-99549646-eaa5-423b-888a-66a9cb535f4a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.559919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99549646-eaa5-423b-888a-66a9cb535f4a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.559980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99549646-eaa5-423b-888a-66a9cb535f4a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.560600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99549646-eaa5-423b-888a-66a9cb535f4a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.560679] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99549646-eaa5-423b-888a-66a9cb535f4a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.847659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.848284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.848284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.848284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.848284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.848651] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 760.881258] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.883557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.883557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.883557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.883557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.892164] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 761.063272] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99549646-eaa5-423b-888a-66a9cb535f4a [ 761.063529] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.063692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.063775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.064321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.064444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.064561] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99549646-eaa5-423b-888a-66a9cb535f4a already deleted. [ 761.064669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99549646-eaa5-423b-888a-66a9cb535f4a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.517122] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f52ce15c-4ac3-4674-a5de-8f724e639079 in Status: SUCCESS [ 761.517428] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 deletion is rescheduled due to dependency. [ 761.517597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.644347] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3fb92f0-fc0b-4646-a5d9-71711b9326cc req-377eb41b-09a2-40d9-8ad2-21cabca395f2 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 761.644954] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 761.645444] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.645622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.645839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.646855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.647118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.647272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.647362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.647563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.647684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.647808] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.075487] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.075487] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.075487] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.075883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.076039] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.076183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.076412] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.076810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.076862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.077132] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.078089] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.078089] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.078089] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.078089] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.078089] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.078089] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.100307] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.100471] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.100603] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.100777] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.101131] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-8a3e8944-78e6-4102-8275-c797943d00ba taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.101299] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.101413] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.101733] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.101904] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a3e8944-78e6-4102-8275-c797943d00ba',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.150226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.150390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.150461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.150670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.150758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.151125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.151186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.151335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.151410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 762.178994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.179628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.179628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.179628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.179628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.190164] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 762.605957] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.606145] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.606205] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.606550] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.606726] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.607018] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 8a3e8944-78e6-4102-8275-c797943d00ba not found, creating... [ 762.607208] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.607373] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.607567] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.607801] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.608040] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.608295] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.608497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.608648] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.608818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.608945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.610280] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 8a3e8944-78e6-4102-8275-c797943d00ba is going to be created. [ 762.639581] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.639805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.639924] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.640269] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.640505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.640732] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.905639] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.905639] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.905639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.905639] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.408755] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.409091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.409091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.409337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.409402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.409505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.409568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.409717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.409806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.409895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.410198] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.410198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.410198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.410358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.410621] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.410621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.410724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.410800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.410860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.410941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.411042] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.431997] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3fb92f0-fc0b-4646-a5d9-71711b9326cc req-fba44ede-eda3-4600-86a3-3ecf397fc432 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 763.432322] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3fb92f0-fc0b-4646-a5d9-71711b9326cc req-fba44ede-eda3-4600-86a3-3ecf397fc432 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 763.432647] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3fb92f0-fc0b-4646-a5d9-71711b9326cc req-fba44ede-eda3-4600-86a3-3ecf397fc432 service nova] Enqueued Resource ID: 8a3e8944-78e6-4102-8275-c797943d00ba with Priority: HIGHEST for action port [ 763.433203] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 763.433384] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 763.433491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a3e8944-78e6-4102-8275-c797943d00ba with Priority: HIGHEST for action port [ 763.433772] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.434234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.434345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.434718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.434718] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.436133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.436133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.436346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a3e8944-78e6-4102-8275-c797943d00ba taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.436346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.436461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.437814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.437814] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a3e8944-78e6-4102-8275-c797943d00ba',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.914139] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1: rpc.has_security_group_logging(os_id): False [ 763.932558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.932806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.932806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.933168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.933229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.933469] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.933582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.933647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.933823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.933928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.934187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.934310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.934397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.934552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.934643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.934850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.934952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.935138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.935314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.935388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.935487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 763.938361] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.938494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942015] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a3e8944-78e6-4102-8275-c797943d00ba with status ACTIVE [ 763.942257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.943094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.943201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.943394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.943475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.943693] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.943866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.943919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.944078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.944158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.944240] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a3e8944-78e6-4102-8275-c797943d00ba is going to be updated. [ 763.970488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.970743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.970814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.971049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.971262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.971470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a3e8944-78e6-4102-8275-c797943d00ba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.010935] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.011158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.011202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.015795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.015795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.024209] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 764.200566] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 764.200760] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 764.200868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.201049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.201286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.201477] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.201707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.201758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.201942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.202063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.202192] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.704439] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.207837] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.710370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.710782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.710782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.710946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.711053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.711159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 765.745493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.745687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.745687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.745805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.747251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.758017] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 765.901282] env[65738]: INFO networking_nsxv3.common.synchronization [req-eeb1be35-dce8-412e-a8a7-54009f2facaa req-9884e374-a946-4a50-a688-431821105419 tempest-ServerRescueTestJSON-1769012266 tempest-ServerRescueTestJSON-1769012266-project-member] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 765.902020] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 765.902545] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.902805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.902955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.903394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.903679] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.903898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.904061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.904342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.904552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.904779] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.040800] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 766.041228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.407077] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.914028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.352032] env[65738]: INFO networking_nsxv3.common.synchronization [req-57b2524d-4705-425b-8162-fd91cd234531 req-9a0e72da-c6b9-43e5-a09e-d9ad6c9cb7c5 tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 767.352607] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 767.352904] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.353105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.353418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.353734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.354085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.354262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.354356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.354455] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.412041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.412205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.412273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.412489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.412581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.412679] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be updated. [ 767.444972] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.445143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.445210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.445433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.445601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.456051] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 767.769037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 767.769339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.769597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.769877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.770119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.770343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.770343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.770518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.770628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.770699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.770794] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.774796] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.774971] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.775106] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.775403] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.775685] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.775825] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.775929] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.778542] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.778701] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.778920] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.779049] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.779160] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.779264] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.779369] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.779479] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.780105] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.802924] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.803170] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.803366] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.803908] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.803908] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-a045b9a1-c18b-481e-b7b6-5a39e24afcad taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.804194] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.804361] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.804730] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.804915] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a045b9a1-c18b-481e-b7b6-5a39e24afcad',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.857583] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.857881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.858016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.858292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.858357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.858594] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.859238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.859238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.859477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.859604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.859708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d already deleted. [ 767.859792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.273352] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.273754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.273754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.274038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.274038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.274139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.274139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.274656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.274656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.274656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.274827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.274827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.275012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.275012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.275130] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.275230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.275281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.275424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.275503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.275566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.275668] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.296029] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a972165e-8c59-4f90-a183-ae1f54d6ec5f None None] Enqueued Resource ID: 1e49714c-4062-416e-878c-8ebb10d6ffd6 with Priority: HIGHEST for action port [ 768.296029] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e49714c-4062-416e-878c-8ebb10d6ffd6 with Priority: HIGHEST for action port [ 768.296480] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e49714c-4062-416e-878c-8ebb10d6ffd6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.297382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e49714c-4062-416e-878c-8ebb10d6ffd6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.297382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e49714c-4062-416e-878c-8ebb10d6ffd6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.297382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e49714c-4062-416e-878c-8ebb10d6ffd6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.297382] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e49714c-4062-416e-878c-8ebb10d6ffd6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.308108] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.310602] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port a045b9a1-c18b-481e-b7b6-5a39e24afcad not found, creating... [ 768.310602] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.310602] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.311873] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.312462] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.314127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.314127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.314127] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.314127] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: a045b9a1-c18b-481e-b7b6-5a39e24afcad is going to be created. [ 768.336838] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.337088] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.337218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.337568] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.337827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.338094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.779026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 768.800878] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e49714c-4062-416e-878c-8ebb10d6ffd6 [ 768.801235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.801747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.801899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.802186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.803965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.803965] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e49714c-4062-416e-878c-8ebb10d6ffd6 already deleted. [ 768.803965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e49714c-4062-416e-878c-8ebb10d6ffd6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.803965] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.803965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.803965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.804403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.804403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.805780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.805780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.805780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.806192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.806999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.807891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.807891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.807891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.807891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.807891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.807891] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 768.884255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.884255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.884255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.887873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.887873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.933305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 769.106206] env[65738]: INFO networking_nsxv3.common.synchronization [req-57b2524d-4705-425b-8162-fd91cd234531 req-edc62e8d-5f74-45ce-b6ba-e8a350b651b4 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 769.106385] env[65738]: INFO networking_nsxv3.common.synchronization [req-57b2524d-4705-425b-8162-fd91cd234531 req-edc62e8d-5f74-45ce-b6ba-e8a350b651b4 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 769.106538] env[65738]: INFO networking_nsxv3.common.synchronization [req-57b2524d-4705-425b-8162-fd91cd234531 req-edc62e8d-5f74-45ce-b6ba-e8a350b651b4 service nova] Enqueued Resource ID: a045b9a1-c18b-481e-b7b6-5a39e24afcad with Priority: HIGHEST for action port [ 769.107065] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 769.107587] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 769.107709] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a045b9a1-c18b-481e-b7b6-5a39e24afcad with Priority: HIGHEST for action port [ 769.107986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.112097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.112097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.112097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.112097] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.112474] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.112474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.112474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.112582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.112714] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.112810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.112870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.113035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.113123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.113213] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.115217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a045b9a1-c18b-481e-b7b6-5a39e24afcad taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.115217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.115217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.115217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.115217] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a045b9a1-c18b-481e-b7b6-5a39e24afcad',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.468269] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 769.468269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.617657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.617657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.619705] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.620110] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a045b9a1-c18b-481e-b7b6-5a39e24afcad with status ACTIVE [ 769.620110] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.620315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.620315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.620708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.620708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.620708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.620822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.620892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.621030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.621102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.621338] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.621488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.621556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.622088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.622088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.622088] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a045b9a1-c18b-481e-b7b6-5a39e24afcad is going to be updated. [ 769.651631] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.651786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.651847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.652095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.652264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.652472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a045b9a1-c18b-481e-b7b6-5a39e24afcad" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.124074] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.182703] env[65738]: INFO networking_nsxv3.common.synchronization [req-ebd45f2b-3aae-43d4-b640-dcad38215316 req-d050d2b9-d7cd-4429-9096-de3b1678d174 tempest-ServersNegativeTestJSON-2088787331 tempest-ServersNegativeTestJSON-2088787331-project-member] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 770.183384] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 770.183670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.183789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.183887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.184128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.184303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.184415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.184467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.185209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.185209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.185209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.229218] env[65738]: INFO networking_nsxv3.common.synchronization [req-de5432c8-0cf5-4be1-9782-55973d6b4e70 req-a4ae9388-81b3-49c7-bcf4-d7505c359a37 tempest-ServersTestFqdnHostnames-505815451 tempest-ServersTestFqdnHostnames-505815451-project-member] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 770.229963] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGHEST for action security_group_members [ 770.230382] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.230508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.230577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.230846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.231026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.231129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.231947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.233712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.233712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.233712] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.626925] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.627254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.627254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.627324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.627411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.628430] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be created. [ 770.657692] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.657692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.657834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.672268] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: UNINITIALIZED for 2s [ 770.687888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.720154] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a5c08a73-be99-4139-9185-8b40ca2807c2 None None] Enqueued Resource ID: e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb with Priority: HIGHEST for action port [ 770.720154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb with Priority: HIGHEST for action port [ 770.720154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.720154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.720614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.722149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.722421] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.735542] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.735706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.735755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.739024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.739024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.739024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 is going to be updated. [ 770.768942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.769144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.769185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.769643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.769643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.776945] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.777362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.777884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.778531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.779072] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.779570] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.779570] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.779873] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.780053] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.780350] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.780791] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.780791] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.780791] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.780950] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.781394] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.781597] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.783732] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: IN_PROGRESS for 2s [ 770.812818] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.812818] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.812818] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.813103] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.813593] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.813917] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.814101] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.814525] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.815195] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b580efe3-a7d2-4ebc-9b4d-e98d8b313aab',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.949511] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 770.949511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.191478] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.227199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb [ 771.227199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.227199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.227199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.227398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.227431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.228034] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb already deleted. [ 771.228034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e819fae3-1bd8-4d3b-9b96-bf21fa4a67bb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.317540] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.317755] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.317942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.318307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.318498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.318674] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port b580efe3-a7d2-4ebc-9b4d-e98d8b313aab not found, creating... [ 771.318982] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.319186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.319352] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.319555] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.319725] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.320068] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.320261] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.320384] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.320600] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.320787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.321067] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: b580efe3-a7d2-4ebc-9b4d-e98d8b313aab is going to be created. [ 771.353782] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.354100] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.354371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.354603] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.354845] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.355103] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.693951] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.694434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.695032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.695258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.695662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.695662] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 771.727687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.727853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.727912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.728124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.728272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.739052] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 772.049065] env[65738]: INFO networking_nsxv3.common.synchronization [req-ebd45f2b-3aae-43d4-b640-dcad38215316 req-6640f2eb-aca2-4abb-99e6-378e2aa815d9 service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 772.049239] env[65738]: INFO networking_nsxv3.common.synchronization [req-ebd45f2b-3aae-43d4-b640-dcad38215316 req-6640f2eb-aca2-4abb-99e6-378e2aa815d9 service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 772.049372] env[65738]: INFO networking_nsxv3.common.synchronization [req-ebd45f2b-3aae-43d4-b640-dcad38215316 req-6640f2eb-aca2-4abb-99e6-378e2aa815d9 service nova] Enqueued Resource ID: b580efe3-a7d2-4ebc-9b4d-e98d8b313aab with Priority: HIGHEST for action port [ 772.049902] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 772.050049] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 772.050205] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b580efe3-a7d2-4ebc-9b4d-e98d8b313aab with Priority: HIGHEST for action port [ 772.050424] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.050663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.050663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.050841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.050882] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.051724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.051827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.052078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.052312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.052378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.052649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.052748] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b580efe3-a7d2-4ebc-9b4d-e98d8b313aab',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.555600] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.555600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.555792] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b580efe3-a7d2-4ebc-9b4d-e98d8b313aab with status ACTIVE [ 772.556025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.556158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.556249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.556474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.556590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.556801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.556923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.556986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.557685] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.557685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.557685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.558572] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b580efe3-a7d2-4ebc-9b4d-e98d8b313aab is going to be updated. [ 772.583759] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.583955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.584054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.584260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.584492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.584788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b580efe3-a7d2-4ebc-9b4d-e98d8b313aab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.688026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 772.688026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.688912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.688912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.689134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.689225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.689264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.689497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.689554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.689629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.689993] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.794758] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6395845-092a-4b5c-9563-8ce89b93f461 in Status: SUCCESS [ 772.795141] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 deletion is rescheduled due to dependency. [ 772.795141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.082088] env[65738]: INFO networking_nsxv3.common.synchronization [req-9afe7294-1cca-4b12-8319-3af59ef8af4e req-54e24a35-66cc-45da-b09e-6970c692a622 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 773.082628] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 773.082929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.083299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.083299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.083473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.083521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.083624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.083677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.083827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.083896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.087023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.191945] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.460873] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.461114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.461206] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.461585] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.461847] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.462010] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.466560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.466560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.466560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.466560] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.466560] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.466560] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.466560] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.466560] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.466560] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.466560] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.491932] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.494510] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.494510] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.494510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.494510] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-2ce393ca-277a-47a2-a70d-0dea072777f2 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.494510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.494510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.494510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.494510] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ce393ca-277a-47a2-a70d-0dea072777f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.588838] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.695129] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b02ac3e-b94a-42ba-b911-23fb0744001d: rpc.has_security_group_logging(os_id): False [ 773.715790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.715998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.715998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.716253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.716348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.716594] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.716695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.716751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.716902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.716972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.717079] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be created. [ 773.748199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 773.748423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.748614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.748839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.749038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.749363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.749363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.749363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.749527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.749527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.782668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.782878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.783415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.783415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.783415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.797188] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 773.997670] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.997910] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.998047] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.998936] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.998936] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.998936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 2ce393ca-277a-47a2-a70d-0dea072777f2 not found, creating... [ 773.998936] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.999265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.999265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.999487] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.999636] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.000071] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.000266] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.000390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.000734] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.000954] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.001167] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 2ce393ca-277a-47a2-a70d-0dea072777f2 is going to be created. [ 774.025801] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.026065] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.026256] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.026498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.026725] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.027197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.089464] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.252831] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.593694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.593694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.593694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.593694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.594112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.594112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 774.624889] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.625056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.625133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.625349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.625491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.638558] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 774.757183] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.770808] env[65738]: INFO networking_nsxv3.common.synchronization [req-9afe7294-1cca-4b12-8319-3af59ef8af4e req-2b836eba-7267-470d-9d96-5d147854de10 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 774.770981] env[65738]: INFO networking_nsxv3.common.synchronization [req-9afe7294-1cca-4b12-8319-3af59ef8af4e req-2b836eba-7267-470d-9d96-5d147854de10 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 774.771219] env[65738]: INFO networking_nsxv3.common.synchronization [req-9afe7294-1cca-4b12-8319-3af59ef8af4e req-2b836eba-7267-470d-9d96-5d147854de10 service nova] Enqueued Resource ID: 2ce393ca-277a-47a2-a70d-0dea072777f2 with Priority: HIGHEST for action port [ 774.772856] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 774.773030] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 774.773180] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce393ca-277a-47a2-a70d-0dea072777f2 with Priority: HIGHEST for action port [ 774.773736] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.774228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.774301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.774506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.774593] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.775482] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.775597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.775807] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ce393ca-277a-47a2-a70d-0dea072777f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.775903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.779178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.779424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.779517] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ce393ca-277a-47a2-a70d-0dea072777f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.259418] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.259906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.259906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.259999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.260068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.260189] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 775.281208] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.281407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.283886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ce393ca-277a-47a2-a70d-0dea072777f2 with status ACTIVE [ 775.284117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.284293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.284411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.284652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.285043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.285043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.285043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.285213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.285835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.285835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.285835] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.285835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.285835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.286098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.286098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.286098] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ce393ca-277a-47a2-a70d-0dea072777f2 is going to be updated. [ 775.306587] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.306898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.306898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.306999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.307102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.311758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.311933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.311933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.312147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.312281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.312436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ce393ca-277a-47a2-a70d-0dea072777f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.317896] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 775.766319] env[65738]: INFO networking_nsxv3.common.synchronization [req-d25dfddd-b104-4d18-8ce2-0ddcf3c2e400 req-24d0b2e4-827a-417d-836b-3498e9a91e78 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 775.766889] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 775.767245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.767374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.767434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.767696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.767859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.767951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.768015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.768428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.768563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.768631] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.809620] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 775.809867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.128186] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.128186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.128186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.128186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.132032] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.132032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.132032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.132032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.132032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.132032] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.132032] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.132032] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.132032] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.132032] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.132032] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.132032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.158595] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.158863] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.159089] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.159401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.159814] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-68fd84ef-89e0-4919-ad2e-5738bc4a7805 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.160018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.160144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.160587] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.160774] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68fd84ef-89e0-4919-ad2e-5738bc4a7805',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.271559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.271956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.271956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.272093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.272187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.272409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.272766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.272766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.272766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.272899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.272899] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d already deleted. [ 776.272985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.652054] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 776.652054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.652054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.652266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.652819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.652819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.652819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.652819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.652819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.653087] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.664360] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.664610] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.664755] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.665186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.665296] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.665509] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 68fd84ef-89e0-4919-ad2e-5738bc4a7805 not found, creating... [ 776.665783] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.665979] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.666146] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.666403] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.666571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.666915] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.669339] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.669534] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.669873] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.670069] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.670265] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 68fd84ef-89e0-4919-ad2e-5738bc4a7805 is going to be created. [ 776.699463] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.699725] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.699855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.700219] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.700530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.700827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.155714] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.329011] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 777.329399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.329449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.329632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.329827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.329948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.330027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.330176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.330282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.330329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.330422] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.414500] env[65738]: INFO networking_nsxv3.common.synchronization [req-d25dfddd-b104-4d18-8ce2-0ddcf3c2e400 req-a753fe4b-63b9-492e-ad87-4a8a4d03224f service nova] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 777.414728] env[65738]: INFO networking_nsxv3.common.synchronization [req-d25dfddd-b104-4d18-8ce2-0ddcf3c2e400 req-a753fe4b-63b9-492e-ad87-4a8a4d03224f service nova] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 777.414865] env[65738]: INFO networking_nsxv3.common.synchronization [req-d25dfddd-b104-4d18-8ce2-0ddcf3c2e400 req-a753fe4b-63b9-492e-ad87-4a8a4d03224f service nova] Enqueued Resource ID: 68fd84ef-89e0-4919-ad2e-5738bc4a7805 with Priority: HIGHEST for action port [ 777.415369] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_rules [ 777.415504] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 777.415602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68fd84ef-89e0-4919-ad2e-5738bc4a7805 with Priority: HIGHEST for action port [ 777.415866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.415987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.416227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.416437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.416517] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.417740] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.417944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.418036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.418735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.418735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.418735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.418735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.418735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.418735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.418972] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.420443] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-68fd84ef-89e0-4919-ad2e-5738bc4a7805 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.420443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.420443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.420584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.420615] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68fd84ef-89e0-4919-ad2e-5738bc4a7805',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.658455] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.833058] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.833224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.833578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.833578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.834153] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.834153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.834153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.834153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.834153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.834438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.834438] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.834538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.834538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.834809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.834809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.834944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.834984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.835150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.835230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.835331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.835427] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.918172] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.918593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.919941] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.921795] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68fd84ef-89e0-4919-ad2e-5738bc4a7805 with status ACTIVE [ 777.922544] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.924589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.924589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.924860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.924944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.925199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.925358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.925405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.925589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.925695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.925953] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.926084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.926145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.926287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.926363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.926448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68fd84ef-89e0-4919-ad2e-5738bc4a7805 is going to be updated. [ 777.954903] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.955535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.955627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.955836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.955996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.956247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68fd84ef-89e0-4919-ad2e-5738bc4a7805" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.163855] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.164031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.164193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.164502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.164645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.164801] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 778.202034] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.202195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.202271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.202472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.202621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.214162] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 778.338012] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89618efc-1c71-4f3b-9cfc-d651fcf1fe99: rpc.has_security_group_logging(os_id): False [ 778.359048] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.359274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.359350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.359596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.359713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.359988] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.360141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.360202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.360454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.360550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.360697] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.361467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.361467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.361467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.361467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.361467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.361694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.361694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.362132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.362132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.362132] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 778.423084] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.427792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.427792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.427792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.428061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.428061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.443319] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 778.927152] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.927259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.927301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.928028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.928028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.928028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d is going to be created. [ 778.955675] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.955675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.955675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.955675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.955675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.991804] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: UNINITIALIZED for 2s [ 780.224930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 780.224930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.225289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.225289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.225397] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.225517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.225585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.225739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.225922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.226029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.226105] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.460860] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 780.461093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.729698] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.729908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.730070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.730193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.730405] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.730519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.730583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.730778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.730903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.731018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.731571] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.731679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.731739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.731916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.732113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.732224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.732306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.732479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.732575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.732683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.732778] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.002717] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: SUCCESS [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.004022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.004022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.004363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.004363] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.236133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84a7a11-9309-4895-a6a4-e6d1f1dddb0b: rpc.has_security_group_logging(os_id): False [ 781.262136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.262359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.262463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.263084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.263084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.263084] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.263549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.263756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.263956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.264059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.264620] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.265266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.265266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.265266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.265266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.265626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.265726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.265814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.266221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.266221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.266221] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 781.343936] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.344188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.344354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.344644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.344836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.366706] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 781.509549] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.012558] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a8cba6c-0779-4246-9afd-ecae574e4c9d: rpc.has_security_group_logging(os_id): False [ 782.036070] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.036070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.036070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.036070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.036070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.036539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.036627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.036763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.036818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.036944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.037023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d is going to be created. [ 782.099654] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.100270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.100403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.101022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.101248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.114460] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: IN_PROGRESS for 2s [ 782.417347] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 782.418122] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 782.792194] env[65738]: INFO networking_nsxv3.common.synchronization [req-62644746-9aba-474b-86e4-96d0bb7bf38c req-dde56014-e4fc-4d07-b4e8-fc832b7f369d tempest-ServersNegativeTestJSON-2088787331 tempest-ServersNegativeTestJSON-2088787331-project-member] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 782.792963] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 782.793445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.793671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.793769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.795484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.795697] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.795814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.795877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.796187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.796334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.796446] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.301919] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.384476] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 783.385669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.804929] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.919683] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3489127-e979-459d-9e7a-00933e6275af req-323e8472-7f84-49b8-b0b5-7e64739c9be1 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 783.920440] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 783.922882] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.923121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.923226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.923500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.923719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.923856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.924256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.924256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.924256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.924396] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.127475] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: SUCCESS [ 784.127586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.270366] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.270579] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.270828] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.271234] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.271692] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.271897] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.272140] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.273008] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.273303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.273648] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.273915] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.274085] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.274277] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.274524] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.274671] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.274897] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.298877] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.298877] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 784.299082] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.299213] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.299526] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.299703] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.299871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.300229] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.300364] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb7be5d-df35-4015-a63a-fa49e3a4cdd2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.306402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.306560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.306669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.306897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.307042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.307151] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 784.358433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.358658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.358658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.358814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.358990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.369905] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 784.427465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.427729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.427833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.428127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.428246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.428516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.428625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.428625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.428819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.428874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.428935] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 already deleted. [ 784.428996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.802667] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.802996] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.803218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.803528] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.803801] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.803972] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 not found, creating... [ 784.804333] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.804540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.804856] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.805078] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.805310] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.805508] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.805678] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.805810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.806103] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.806262] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.806428] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 is going to be created. [ 784.830359] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.830697] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.830841] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.831126] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.831347] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.831591] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.538257] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3489127-e979-459d-9e7a-00933e6275af req-0bf9d3e0-d487-4b07-a3f2-b3d72410f4c4 service nova] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_rules [ 785.538673] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3489127-e979-459d-9e7a-00933e6275af req-0bf9d3e0-d487-4b07-a3f2-b3d72410f4c4 service nova] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 785.538965] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3489127-e979-459d-9e7a-00933e6275af req-0bf9d3e0-d487-4b07-a3f2-b3d72410f4c4 service nova] Enqueued Resource ID: 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 with Priority: HIGHEST for action port [ 785.539637] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_rules [ 785.539896] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 785.540077] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 with Priority: HIGHEST for action port [ 785.540382] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.540641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.541778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.541778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.541778] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.541997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.542066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.542329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.542329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.542545] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.542545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.542545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.542685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.542762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.542903] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.544036] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.544036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.544036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.544036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.544036] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb7be5d-df35-4015-a63a-fa49e3a4cdd2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.046519] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.046817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.046861] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.048263] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 with status ACTIVE [ 786.048456] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.048580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.049322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.049322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.049322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.049322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.050738] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.050738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.050738] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bb7be5d-df35-4015-a63a-fa49e3a4cdd2 is going to be updated. [ 786.075420] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.075618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.075618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.075844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.076046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.076237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb7be5d-df35-4015-a63a-fa49e3a4cdd2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.379453] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 786.379683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.552458] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.057745] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.057745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.057745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.057745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.057745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.057745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be created. [ 787.083615] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.083883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.083944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.084318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.084550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.097069] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: UNINITIALIZED for 2s [ 788.847237] env[65738]: INFO networking_nsxv3.common.synchronization [req-47c884ad-05db-4a3a-afcc-2bf1a8a2bbf6 req-b5f02771-0442-4107-aac0-1f54e1eff704 tempest-ServersAdminNegativeTestJSON-1268383286 tempest-ServersAdminNegativeTestJSON-1268383286-project-member] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 788.847237] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 788.847677] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.847988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.849960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.849960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.849960] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.885762] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.885902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.885902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.886221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.886345] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.121434] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 789.122150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.125214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.125214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.125214] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.125214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.125214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.125214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.126284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.126465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.126705] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.247816] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.248023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.248227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.248536] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.248801] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.248958] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.249204] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.249454] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.249633] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.249891] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.250028] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.250140] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.250266] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.250418] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.250551] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.250691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.273337] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.273337] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.273705] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.273705] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.274110] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-b9459728-3325-4322-92b6-61a1111a36ac taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.274302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.274402] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.274731] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.274864] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9459728-3325-4322-92b6-61a1111a36ac',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.352712] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.389398] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.548472] env[65738]: INFO networking_nsxv3.common.synchronization [req-f4b6d7c6-5f41-42ed-b9c1-e3bb977ccb13 req-de7862ee-963f-48c3-bfdf-8d2fd88b1aab tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 789.549208] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 789.549335] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.549449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.549512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.549719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.549866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.549982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.550594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.550594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.550594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.550594] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.630931] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.630931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.630931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.630931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.631250] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.631250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.631250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.631373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.631503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.631559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.631685] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.631773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.631828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.631971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.632149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.632245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.632305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.632492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.632660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.632719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.632767] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.781395] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.781607] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.781745] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.782057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.782196] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.782344] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port b9459728-3325-4322-92b6-61a1111a36ac not found, creating... [ 789.782642] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.782940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.782940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.783164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.783289] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.783577] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.783715] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.783853] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.784168] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.784303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.784438] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: b9459728-3325-4322-92b6-61a1111a36ac is going to be created. [ 789.809442] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.809717] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.809866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.810926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.811273] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.814267] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.854107] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.892094] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.052521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.052802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.052802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.053053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.053119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.053287] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.053393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.053448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.053594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.053714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.053820] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be updated. [ 790.092957] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.093171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.093246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.093484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.094239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.111405] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: IN_PROGRESS for 2s [ 790.135041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd260df1-27ce-4a10-8b11-543f9fd7f080: rpc.has_security_group_logging(os_id): False [ 790.155099] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.155099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.155099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.155099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.155099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.155099] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.155579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.155579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.155579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.155730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.155793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.155880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.155932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.156123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.156283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.156359] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.156449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.156449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.156592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.156656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.156738] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be created. [ 790.222241] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.222241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.222241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.222241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.235148] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: IN_PROGRESS for 2s [ 790.356458] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.356624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.356694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.356917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.357628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.357628] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 790.395041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 790.395041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 790.396688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.396830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.396925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.397133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.397281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.409286] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [req-47c884ad-05db-4a3a-afcc-2bf1a8a2bbf6 req-a670ef76-0d47-45a5-9cb8-ac68ab3fc251 service nova] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_rules [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [req-47c884ad-05db-4a3a-afcc-2bf1a8a2bbf6 req-a670ef76-0d47-45a5-9cb8-ac68ab3fc251 service nova] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [req-47c884ad-05db-4a3a-afcc-2bf1a8a2bbf6 req-a670ef76-0d47-45a5-9cb8-ac68ab3fc251 service nova] Enqueued Resource ID: b9459728-3325-4322-92b6-61a1111a36ac with Priority: HIGHEST for action port [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_rules [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 790.572994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9459728-3325-4322-92b6-61a1111a36ac with Priority: HIGHEST for action port [ 790.572994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.574141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.576112] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.576112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.576112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9459728-3325-4322-92b6-61a1111a36ac taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.576112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.576509] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9459728-3325-4322-92b6-61a1111a36ac',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.078836] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.078836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.078836] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9459728-3325-4322-92b6-61a1111a36ac with status ACTIVE [ 791.078836] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.079307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.079307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.079372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.079508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.079697] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.079800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.079864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.080100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.080210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.080423] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.080566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.080658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.080833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.080934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.081054] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9459728-3325-4322-92b6-61a1111a36ac is going to be updated. [ 791.109844] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.109844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.109844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.110279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.110317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.111036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9459728-3325-4322-92b6-61a1111a36ac" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.203155] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.203342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.203390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.204064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.221261] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 791.222228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.223421] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 791.256062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.256269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.256313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.256508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.263296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.263974] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 791.264089] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.264160] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 791.324719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.324976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.325070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.326249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.326767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.327065] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 791.397985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.397985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.397985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.399028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.399028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.399156] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 791.469952] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.470065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.470162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.470485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.470806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.471300] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 791.471934] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'72af6c3f-606c-49b1-8ed2-d3711bffee90', 'f52ce15c-4ac3-4674-a5de-8f724e639079', '728b373a-0a9d-4e10-b5ee-d0b6e2a75682', '1c7d7f2c-977a-4487-9860-998b141f77f2', 'f6395845-092a-4b5c-9563-8ce89b93f461', 'e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e', '2c141272-ba24-462d-b6ed-4f263864d60c', 'fb392433-b27c-4f33-a766-634f0f6c0dcb', 'e974415d-6bf2-41ac-b8e6-2817575b8abd', '5655ef30-50fd-430d-8d49-08277c5e5c9f', 'beba0424-1a8e-44c6-90d2-7d725d4330cd', '2ad6c20a-9f8d-463c-b372-a35a03d15c46', '7f6f7207-78fd-4f30-bb10-327e2c3450e8', 'bf78d499-f745-40ce-9541-deee900c2003', 'adec5b77-f6bd-4b0d-8254-ba4bb52f63e3', '98ae3e4c-e240-4cb3-a347-31d18a23b3fa', '907c22c5-ad71-4896-a4e9-e9855577ba3c', '3b02ac3e-b94a-42ba-b911-23fb0744001d', 'dd260df1-27ce-4a10-8b11-543f9fd7f080', 'a84a7a11-9309-4895-a6a4-e6d1f1dddb0b', '1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2', '0a8cba6c-0779-4246-9afd-ecae574e4c9d', '5fb1ec78-dd9a-4648-b8b0-a049555e5a46', 'ad710818-9f6b-4718-bff8-4836e8a61c3b', '194d1d45-daf3-4873-a0c4-a279f2704021', '13e04b13-1f3c-4f36-a68f-be19736a3742', '93ac889c-a70d-42e4-9f0a-90c362835c16', '47750d4b-22bd-42e5-bf36-3cc17e08c0a0', '2b5f20e7-94a1-4514-adde-54a6960390c3', '21f8f014-13fa-4be1-97eb-834dadab33fd', '7e040984-bcc9-43b0-a9c8-bbd4511a7fc1', 'a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c', '33ab54d8-f174-4187-9e64-2cd39cd90273', '89618efc-1c71-4f3b-9cfc-d651fcf1fe99'} {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.471934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 791.496540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.496540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.496540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.496707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.496791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.496902] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 791.496975] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.497059] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 791.562269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.562432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.562507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.562701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.563561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.563788] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 791.563958] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.564069] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 791.564142] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 791.564221] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 791.564292] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGH for action security_group_rules [ 791.564373] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGH for action security_group_rules [ 791.564440] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGH for action security_group_rules [ 791.564503] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGH for action security_group_rules [ 791.564565] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGH for action security_group_rules [ 791.564627] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGH for action security_group_rules [ 791.564686] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 791.565455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 791.566549] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGH for action security_group_rules [ 791.566549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.124111] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 792.124439] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 deletion is rescheduled due to dependency. [ 792.124439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.252817] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 792.253173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.422459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 792.422690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.422866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.423152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.423485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.423674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.423782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.423991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.424087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.424214] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.927634] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.435440] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.938074] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.938243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.938317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.938547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.938639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.938739] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 793.979680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.979896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.979896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.980226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.980391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.993761] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 793.997502] env[65738]: INFO networking_nsxv3.common.synchronization [req-38115857-6be8-4fbb-b50a-67280b934b77 req-818738c3-034c-49cc-9183-32afa9c3ce0c tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 793.998038] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 793.998620] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGH for action security_group_rules [ 793.998695] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGH for action security_group_rules [ 793.998787] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGH for action security_group_rules [ 793.998885] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 with Priority: HIGH for action security_group_rules [ 793.998982] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGH for action security_group_rules [ 793.999093] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 793.999211] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 793.999327] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c with Priority: HIGH for action security_group_rules [ 793.999432] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78d499-f745-40ce-9541-deee900c2003 with Priority: HIGH for action security_group_rules [ 793.999523] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGH for action security_group_rules [ 793.999613] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGH for action security_group_rules [ 793.999700] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 with Priority: HIGH for action security_group_rules [ 793.999786] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beba0424-1a8e-44c6-90d2-7d725d4330cd with Priority: HIGH for action security_group_rules [ 793.999875] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f with Priority: HIGH for action security_group_rules [ 793.999964] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGH for action security_group_rules [ 794.000063] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e with Priority: HIGH for action security_group_rules [ 794.000152] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 794.000239] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6395845-092a-4b5c-9563-8ce89b93f461 with Priority: HIGH for action security_group_rules [ 794.000328] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52ce15c-4ac3-4674-a5de-8f724e639079 with Priority: HIGH for action security_group_rules [ 794.000427] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 with Priority: HIGH for action security_group_rules [ 794.000707] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.000824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.000890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.001163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.001323] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.001421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.001481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.001631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.001713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.001828] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.002856] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.002856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.003034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.003034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.003118] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.004693] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.004693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.004693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.004693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.004887] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.006041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.007724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.007812] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.007928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.008037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.008209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.008296] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adec5b77-f6bd-4b0d-8254-ba4bb52f63e3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.009440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.009913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.009913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.009913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.009913] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.012059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.012059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.012059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.013185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.013185] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.013185] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.013185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.013185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.014348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.014348] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.016354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-907c22c5-ad71-4896-a4e9-e9855577ba3c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.016354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.016354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.016354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.017035] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('907c22c5-ad71-4896-a4e9-e9855577ba3c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.018842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf78d499-f745-40ce-9541-deee900c2003 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.018842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.018842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.019062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.019101] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf78d499-f745-40ce-9541-deee900c2003',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.019895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.021892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.022014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.022188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.022262] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.023284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.023395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.023439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.023585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.023657] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.023915] env[65738]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 794.024666] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.024764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.024817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.024996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.025399] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ad6c20a-9f8d-463c-b372-a35a03d15c46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.027042] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beba0424-1a8e-44c6-90d2-7d725d4330cd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.027159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.027208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.027332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.027401] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beba0424-1a8e-44c6-90d2-7d725d4330cd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.028646] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5655ef30-50fd-430d-8d49-08277c5e5c9f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.028762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.028813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.028970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.029121] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5655ef30-50fd-430d-8d49-08277c5e5c9f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.029943] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030320] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.031285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.031285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.031285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.031442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.031512] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.032513] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.032612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.032684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.032829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.032900] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.033819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6395845-092a-4b5c-9563-8ce89b93f461 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.033966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.034034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034246] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6395845-092a-4b5c-9563-8ce89b93f461',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.035110] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f52ce15c-4ac3-4674-a5de-8f724e639079 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.035233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.035470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.035470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.035577] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f52ce15c-4ac3-4674-a5de-8f724e639079',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.036426] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c7d7f2c-977a-4487-9860-998b141f77f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.036574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.036574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.036762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.036881] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c7d7f2c-977a-4487-9860-998b141f77f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.479913] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.479913] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.479913] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.480382] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.480859] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.480859] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.481076] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.481253] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.481431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.481711] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.481911] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.482075] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.482216] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.482369] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.482516] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.482752] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.505394] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.505718] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.505839] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.506100] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.506595] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-1102de98-d6d6-4fc9-814d-2ad00411d89b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.506965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.506965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.507361] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.508168] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1102de98-d6d6-4fc9-814d-2ad00411d89b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.508168] env[65738]: WARNING oslo_messaging._drivers.amqpdriver [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 794.540510] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.541431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.541431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.541431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.541431] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.541431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.541431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.541860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.541860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.541860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.542039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.543389] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.543513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.543593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.543737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.543971] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.544156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.544250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.544450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.544588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.544704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.544843] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.545790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.545901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.545968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.546296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.546383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.546596] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.546688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.546824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.546938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.547047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.547144] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 already deleted. [ 794.547233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.574486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.574683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.574683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.574880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.575063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.575234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.575234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.575374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.575455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.575541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.575671] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.583903] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.583903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.583903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.583903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.584361] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.584361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.584361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.584361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.584582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.584582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.584656] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.589290] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.589290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.589290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.589290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.589290] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.589558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.589558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.589558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.589661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.589661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.589736] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.592559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.592559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.592559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.592559] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.594245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.594367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.594440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.594575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.594713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.594807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.594861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.595229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.595272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.595354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.595438] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.600133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.600275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.600329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.600527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.605254] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.605339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.640997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.641326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.645190] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.645190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.648670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.648840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.650418] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.650712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.652143] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.652143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.653515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.653515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.655190] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.655190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.655864] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.656420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.656864] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.656960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.657593] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 794.658263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.658398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adec5b77-f6bd-4b0d-8254-ba4bb52f63e3 is going to be deleted. [ 794.660166] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.660315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.660423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.660719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.687707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.687845] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ad6c20a-9f8d-463c-b372-a35a03d15c46 is going to be deleted. [ 794.688785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.688994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.711178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.711385] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c7d7f2c-977a-4487-9860-998b141f77f2 is going to be deleted. [ 794.712609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.712712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.726664] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.726919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.734171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.734369] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beba0424-1a8e-44c6-90d2-7d725d4330cd is going to be deleted. [ 794.735839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.736179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.787654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.788820] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf78d499-f745-40ce-9541-deee900c2003 is going to be deleted. [ 794.789986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.789986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.791975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.792145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.844846] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.845131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.845947] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.846132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.849543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.849721] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f52ce15c-4ac3-4674-a5de-8f724e639079 is going to be deleted. [ 794.850683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.850920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.902436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.902436] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be deleted. [ 794.902436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.902825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.934476] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.934709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.941799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.941981] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be deleted. [ 794.942901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.943125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.991175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.991426] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6395845-092a-4b5c-9563-8ce89b93f461 is going to be deleted. [ 794.992332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.992557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.995167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.010992] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.011255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.011381] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.011661] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.011847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.011987] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 1102de98-d6d6-4fc9-814d-2ad00411d89b not found, creating... [ 795.012275] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.012434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.012556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.012808] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.012961] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.013319] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.013580] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.013702] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.013962] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.014128] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.014269] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 1102de98-d6d6-4fc9-814d-2ad00411d89b is going to be created. [ 795.017982] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.017982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.048519] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.050347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.050562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.050562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.050780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.050962] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.051144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.051144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.051345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.051458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.051551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.051647] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.051746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.051825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.051947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.052175] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.052326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.052326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.052473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.052586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.052586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.052733] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.054696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054837] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e is going to be deleted. [ 795.056287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.056478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.081008] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.091539] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.094764] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.094985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.094985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.095257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.095463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.095647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.095708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.095914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.095984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.096066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.096215] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.096307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.096360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.096505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.096645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.096734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.096791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.096962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.097100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.097175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.097242] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.098992] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.099445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.099445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.099522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.099775] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.100021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.101514] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.101697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.101697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.101894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.102084] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.102194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.102309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.102404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.102482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.102566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.102708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.102797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.102850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.102981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.103130] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.103224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.103279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.103401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.103471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.103601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.103676] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.105339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.105478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.105563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.106142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.106322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.106410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.106465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.106618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.106695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.106776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.106920] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.107020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.107074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.107205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.107340] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.107465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.107525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.107632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.107790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.107877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.108343] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.129184] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.129332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.134101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.134257] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5655ef30-50fd-430d-8d49-08277c5e5c9f is going to be deleted. [ 795.135199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.135470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.141160] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.141278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.175386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.175549] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 907c22c5-ad71-4896-a4e9-e9855577ba3c is going to be deleted. [ 795.176563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.176773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.176863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.176984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adec5b77-f6bd-4b0d-8254-ba4bb52f63e3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.177162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.177318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.177394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.177504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ad6c20a-9f8d-463c-b372-a35a03d15c46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.178769] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.178918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.179059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.179137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.179198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.179321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21cb5e0-e5b9-40ec-aaf1-a9a57aa3dc8e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.179448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.179593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.179663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.179933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c7d7f2c-977a-4487-9860-998b141f77f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.179933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.180047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.180105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.180191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beba0424-1a8e-44c6-90d2-7d725d4330cd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.180317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.180461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.180579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.180645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf78d499-f745-40ce-9541-deee900c2003" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.180728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.180907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.180990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f52ce15c-4ac3-4674-a5de-8f724e639079" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.181380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.181452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.181666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.181865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.181954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.182078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.182206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.182343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.182416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.182519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6395845-092a-4b5c-9563-8ce89b93f461" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.313309] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.313519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.313675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.313883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.314176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.314324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-907c22c5-ad71-4896-a4e9-e9855577ba3c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.325045] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 795.325628] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.325799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.325865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.327755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.327950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.328189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5655ef30-50fd-430d-8d49-08277c5e5c9f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.559022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72af6c3f-606c-49b1-8ed2-d3711bffee90: rpc.has_security_group_logging(os_id): False [ 795.561126] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 795.737615] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b02ac3e-b94a-42ba-b911-23fb0744001d: rpc.has_security_group_logging(os_id): False [ 795.738961] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98ae3e4c-e240-4cb3-a347-31d18a23b3fa: rpc.has_security_group_logging(os_id): False [ 795.740078] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84a7a11-9309-4895-a6a4-e6d1f1dddb0b: rpc.has_security_group_logging(os_id): False [ 795.740903] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e974415d-6bf2-41ac-b8e6-2817575b8abd: rpc.has_security_group_logging(os_id): False [ 795.741756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd260df1-27ce-4a10-8b11-543f9fd7f080: rpc.has_security_group_logging(os_id): False [ 795.743956] env[65738]: INFO networking_nsxv3.common.synchronization [None req-cc2098d3-3987-41c2-9322-d3631b1c20af None None] Enqueued Resource ID: 22be0f16-4235-4667-b168-518c0f177bce with Priority: HIGHEST for action port [ 795.744776] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22be0f16-4235-4667-b168-518c0f177bce with Priority: HIGHEST for action port [ 795.746441] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-22be0f16-4235-4667-b168-518c0f177bce taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.746579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22be0f16-4235-4667-b168-518c0f177bce" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.746689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22be0f16-4235-4667-b168-518c0f177bce" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.746947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22be0f16-4235-4667-b168-518c0f177bce" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.747081] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22be0f16-4235-4667-b168-518c0f177bce',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.767394] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.767593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.767593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.767815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.770570] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.770694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.771452] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.771576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.772802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.772891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.774412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.774506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.775206] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.775313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.775923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.776028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.790864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.791233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.791966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.791966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.791966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.791966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.791966] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be updated. [ 795.792962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.793148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.814149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.814461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.814581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.814647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.814847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.814965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.815192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.815291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.815352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.815536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.815589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.815762] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.815841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.815899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.816478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.816592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.816683] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be updated. [ 795.817966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.818089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.821421] env[65738]: INFO networking_nsxv3.common.synchronization [req-38115857-6be8-4fbb-b50a-67280b934b77 req-70d1e722-70e6-4d62-b72a-3bdd740219cc service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 795.821640] env[65738]: INFO networking_nsxv3.common.synchronization [req-38115857-6be8-4fbb-b50a-67280b934b77 req-70d1e722-70e6-4d62-b72a-3bdd740219cc service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 795.821707] env[65738]: INFO networking_nsxv3.common.synchronization [req-38115857-6be8-4fbb-b50a-67280b934b77 req-70d1e722-70e6-4d62-b72a-3bdd740219cc service nova] Enqueued Resource ID: 1102de98-d6d6-4fc9-814d-2ad00411d89b with Priority: HIGHEST for action port [ 795.822935] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 795.823090] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 795.823244] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1102de98-d6d6-4fc9-814d-2ad00411d89b with Priority: HIGHEST for action port [ 795.823485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.823676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.823676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.823899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.824343] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.825809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.825928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.825983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826376] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.827844] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.827844] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1102de98-d6d6-4fc9-814d-2ad00411d89b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.827844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.828657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.828657] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1102de98-d6d6-4fc9-814d-2ad00411d89b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.860630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.860964] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.861147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.861259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.861443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.861443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.861610] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 795.863617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.863862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.896192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.896354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.896579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.896579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.896801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.896872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.897158] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.897253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.897336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.897483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.897602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.897750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.897843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.897896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.898217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.898217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.898334] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 795.899872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.900069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.902141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.902258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.906212] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.906408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.931778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.932699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.933288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.933288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.933288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.933520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.933648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.933772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.934087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.934087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.934273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.934737] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.934737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.934737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.934737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.935029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.935029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 795.936272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.936498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.942573] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.942573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.993639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.993844] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.993922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.994075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.994277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.994351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.994628] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.994736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.994867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.994961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.995063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.995252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.995340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.995392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.995656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.995656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.995940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 795.997799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.997975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.998131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.998979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.999284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.999428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.000649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.000812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.015868] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 796.016133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.016339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.016573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.016787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.016949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.017882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.017882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.017882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.017882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.017882] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.026992] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: IN_PROGRESS for 2s [ 796.039570] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 796.040444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.040819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.040905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.041022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.041143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.041229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.041318] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa is going to be updated. [ 796.042495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.042700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.042847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.108682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.108682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.108682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.108682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.108682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.113794] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.113966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.114061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.114264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.115209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.135608] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 796.167361] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 796.168872] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 796.205124] env[65738]: INFO networking_nsxv3.common.synchronization [req-09e4ab18-1327-494e-a373-5d505b65e822 req-22fc081b-1cad-4501-87d2-09c259685386 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 796.205124] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 796.205124] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.205124] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.205124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.205124] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.210207] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.210344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.210922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.210922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.210922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.241691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 796.248909] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22be0f16-4235-4667-b168-518c0f177bce [ 796.249174] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.249311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.249379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.249600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.249689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.249786] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22be0f16-4235-4667-b168-518c0f177bce already deleted. [ 796.249869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22be0f16-4235-4667-b168-518c0f177bce" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.288287] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.288471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.288515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.288702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.288842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.320230] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: IN_PROGRESS for 2s [ 796.328509] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.328687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.329964] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.330933] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1102de98-d6d6-4fc9-814d-2ad00411d89b with status ACTIVE [ 796.331984] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331984] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.331984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.332372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.332372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.332516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.332924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.332924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.332924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.332924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.333112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1102de98-d6d6-4fc9-814d-2ad00411d89b is going to be updated. [ 796.363314] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.363487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.363599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.363814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.364029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.364216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1102de98-d6d6-4fc9-814d-2ad00411d89b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.522183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.522420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.522506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.522740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.522983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.523129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.523129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.523342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.523462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.523502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.523843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.523843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.523843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.524143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.524216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.524869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.524869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.524869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.524869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.524869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.524869] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.705205] env[65738]: INFO networking_nsxv3.common.synchronization [req-bb089da1-9caa-4a8f-a721-c62829f9cf75 req-62e8d98b-cf69-47d7-b951-cd87ad99b244 tempest-AttachInterfacesV270Test-567602934 tempest-AttachInterfacesV270Test-567602934-project-member] Enqueued Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 796.705205] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 796.705205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.705205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.705205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.705735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.705735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.705826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.705879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.706093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.706225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.706388] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.707758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.708842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.708842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.708842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.708842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.708842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.708842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.709113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.709113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.709230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.709313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 796.746859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.747011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.747091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.747303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.747441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.761275] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 796.836483] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.027459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c141272-ba24-462d-b6ed-4f263864d60c: rpc.has_security_group_logging(os_id): False [ 797.049032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.049032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.049032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.049032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071415] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071415] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.071415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.071890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.071890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.071890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.072073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.072658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.073309] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 797.078623] env[65738]: INFO networking_nsxv3.common.synchronization [None req-34a10b4d-3877-4262-b0f6-6dffa3ac8011 tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 797.079840] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 797.079840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.080099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.080182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.080432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.080504] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.115989] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.116197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-513" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.116314] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-513" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.116684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-513" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.117015] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.118633] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.118766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.118997] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.119232] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.119441] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.119552] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.119657] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.119758] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.119866] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.119980] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.120282] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.138567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.138796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.138873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.139367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.139633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.142251] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.142410] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.142538] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.142765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-513" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.143246] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-a74f5521-e17c-40ca-933b-30a6f05ed799 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.143519] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.143731] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.144202] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.145116] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74f5521-e17c-40ca-933b-30a6f05ed799',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.158158] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 797.212182] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.212351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.212422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.212772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.212864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.213626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.213626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.213626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.213626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.213626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.213626] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ace770a2-a23c-4a11-9747-3be56def5369 already deleted. [ 797.214102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.228385] env[65738]: INFO networking_nsxv3.common.synchronization [None req-56be85d8-4e5f-44d8-bf60-cabd6dfb48ae tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 797.229042] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 797.229383] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.229494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.339858] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.339986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.340049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.341729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.342047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.342354] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be created. [ 797.372020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.372020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.372020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.372020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.372020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.380642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: UNINITIALIZED for 2s [ 797.606908] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.606908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.606908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.606908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.606908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.607455] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 already deleted. [ 797.607455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.607455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.607455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.607455] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.648699] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.648883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.648952] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.649673] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.649768] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.649937] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port a74f5521-e17c-40ca-933b-30a6f05ed799 not found, creating... [ 797.650185] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.650340] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.650453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.650664] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.650794] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.651094] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.651246] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.651357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.651555] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.652319] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.652319] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: a74f5521-e17c-40ca-933b-30a6f05ed799 is going to be created. [ 797.672039] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.672281] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.673360] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.673549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.673787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.674086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.997054] env[65738]: INFO networking_nsxv3.common.synchronization [None req-30adc107-d13b-411b-a78b-305ab91c6866 None None] Enqueued Resource ID: 6ef1399d-8cbe-4701-94e6-882c273c926a with Priority: HIGHEST for action port [ 797.997631] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef1399d-8cbe-4701-94e6-882c273c926a with Priority: HIGHEST for action port [ 797.997945] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ef1399d-8cbe-4701-94e6-882c273c926a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.998086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ef1399d-8cbe-4701-94e6-882c273c926a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.998182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ef1399d-8cbe-4701-94e6-882c273c926a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.998406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ef1399d-8cbe-4701-94e6-882c273c926a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.998513] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef1399d-8cbe-4701-94e6-882c273c926a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.050687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 798.050933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.053801] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 798.054127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.131268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.131268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.131268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.131268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.131512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.131512] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 already deleted. [ 798.131512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.151327] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 798.151327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.187270] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 798.187270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.192859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 798.192859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.270850] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 798.271050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.345137] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: SUCCESS [ 798.345424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.388156] env[65738]: INFO networking_nsxv3.common.synchronization [req-bb089da1-9caa-4a8f-a721-c62829f9cf75 req-fece0654-7ae9-43d9-9c6e-62df05127b97 service nova] Enqueued Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_rules [ 798.388351] env[65738]: INFO networking_nsxv3.common.synchronization [req-bb089da1-9caa-4a8f-a721-c62829f9cf75 req-fece0654-7ae9-43d9-9c6e-62df05127b97 service nova] Enqueued Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 798.388483] env[65738]: INFO networking_nsxv3.common.synchronization [req-bb089da1-9caa-4a8f-a721-c62829f9cf75 req-fece0654-7ae9-43d9-9c6e-62df05127b97 service nova] Enqueued Resource ID: a74f5521-e17c-40ca-933b-30a6f05ed799 with Priority: HIGHEST for action port [ 798.389056] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_rules [ 798.389842] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 798.389842] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a74f5521-e17c-40ca-933b-30a6f05ed799 with Priority: HIGHEST for action port [ 798.389842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.389842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.389842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.390103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.390103] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.391417] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.391624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.391699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.392197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.392197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.392285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.393775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.393775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.393775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.393775] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.393775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a74f5521-e17c-40ca-933b-30a6f05ed799 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.393775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.393775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.394407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.394407] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a74f5521-e17c-40ca-933b-30a6f05ed799',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.502502] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ef1399d-8cbe-4701-94e6-882c273c926a [ 798.502763] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.502975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.502975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.503227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.503337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.503440] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ef1399d-8cbe-4701-94e6-882c273c926a already deleted. [ 798.503560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ef1399d-8cbe-4701-94e6-882c273c926a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.772503] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 798.772740] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 798.772807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.897121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.897259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898218] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.898568] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a74f5521-e17c-40ca-933b-30a6f05ed799 with status ACTIVE [ 798.898741] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.899886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.899886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.901959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.901959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.901959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.901959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.901959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.901959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a74f5521-e17c-40ca-933b-30a6f05ed799 is going to be updated. [ 798.931346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.931562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.931562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.931757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.931921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.932112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a74f5521-e17c-40ca-933b-30a6f05ed799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.174481] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 799.174742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.175300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.175300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.175487] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.391431] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 799.391615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392338] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.393078] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.405061] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.678471] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.678471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.678471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.678471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.678894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.678894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.678894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.679113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.679216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.679305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.679405] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.895510] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.895673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.895739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.895987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.896146] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.896246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.896309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.896481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.896568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.896653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.896803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.897025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.897025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.897143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.897265] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.897373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.897448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.897602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.897681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.897761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.898068] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.908127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.908280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.908392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.908551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.908638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.908748] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ace770a2-a23c-4a11-9747-3be56def5369 is going to be created. [ 799.937238] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.937377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.937472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.937662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.937831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.949757] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: UNINITIALIZED for 2s [ 800.185550] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.185877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.185877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.186054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.186186] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.186287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.186352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.186496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.186582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.186670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.186818] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.186905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.186966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.187218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.187397] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.187491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.187561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.187721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.187817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.187941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.188109] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.402913] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b62a35a-29b0-4826-a035-6eed21356980: rpc.has_security_group_logging(os_id): False [ 800.429038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.429038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.429038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.430300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.430655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.430859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.433842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.433842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.433842] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be created. [ 800.507774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.507959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.508020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.508221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.508396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.520296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 800.692450] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c141272-ba24-462d-b6ed-4f263864d60c: rpc.has_security_group_logging(os_id): False [ 800.715874] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.716998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.717187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.717430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.717430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.717687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.717828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.717828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.718143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.718143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.718539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.718539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.718539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.718766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.718766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.718920] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.719023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.719096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.719182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.719276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.719382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 800.805070] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.805395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.805395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.805608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.805734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.827683] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 801.961493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: SUCCESS [ 801.961493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.961868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.961868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.962135] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.962403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.962403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.962538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.962660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.962771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.962888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.465294] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.465467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.465531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.465815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.466037] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.466145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.466267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.466454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.466631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.466755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.466939] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.467184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.467280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.467470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.467648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.467767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.467838] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.468013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.468119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.468217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.468329] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.534023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 802.534211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.843669] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 802.843911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.976414] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ace770a2-a23c-4a11-9747-3be56def5369: rpc.has_security_group_logging(os_id): False [ 802.997462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.997607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.997672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.998023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.998023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.998217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.998361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.998420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.998568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.998668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.998858] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.998978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.999035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.999183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.999285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.999467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.999596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.999646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.999786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.999887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.999969] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ace770a2-a23c-4a11-9747-3be56def5369 is going to be created. [ 803.092943] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.093231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.093362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.093699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.094035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.114323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: IN_PROGRESS for 2s [ 803.391601] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 803.391828] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 804.091722] env[65738]: INFO networking_nsxv3.common.synchronization [req-db1ce6e6-7fe3-4fb1-a530-745bcc5a708d req-0a6e25d6-e118-48c1-ab49-62341b1640ee tempest-ServerActionsV293TestJSON-1184867836 tempest-ServerActionsV293TestJSON-1184867836-project-member] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 804.092123] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 804.092466] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.092569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.092614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.092857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.093019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.094780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.094866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.095076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.095213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.095335] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.569443] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.569744] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-812" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.569903] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-812" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.570525] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-812" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.570822] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.570979] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.571114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.571420] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.571600] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.571831] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.571970] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.572141] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.572309] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.572449] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.572576] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.572746] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.593359] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.593595] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.593769] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.593976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-812" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.594411] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-965480dd-8154-43e9-9e24-eadc9c16f968 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.594628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.594834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.595188] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.595436] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('965480dd-8154-43e9-9e24-eadc9c16f968',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.598018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.598274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.598274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.598831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.598831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.598831] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.599095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.599095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.599244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.599317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.599387] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 already deleted. [ 804.599461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.785039] env[65738]: INFO networking_nsxv3.common.synchronization [req-dd00e205-e0e5-4a60-a066-a982a2ba8dcb req-e78fe101-ac49-454b-986a-71ee407ebe15 tempest-ServerRescueTestJSON-1769012266 tempest-ServerRescueTestJSON-1769012266-project-member] Enqueued Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 804.785642] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 with Priority: HIGHEST for action security_group_members [ 804.785960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-33ab54d8-f174-4187-9e64-2cd39cd90273 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786564] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.786674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.786726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.786887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.786978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.787086] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33ab54d8-f174-4187-9e64-2cd39cd90273',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.098034] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.098504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.098504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.098954] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.099132] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.099326] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 965480dd-8154-43e9-9e24-eadc9c16f968 not found, creating... [ 805.099624] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.099790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.099905] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.100342] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.100496] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.100863] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.101042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.101159] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.101407] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.101501] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.101640] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 965480dd-8154-43e9-9e24-eadc9c16f968 is going to be created. [ 805.123789] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.124070] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.124193] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.124496] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.124854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.125093] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.126517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: SUCCESS [ 805.126700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.289305] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.289503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.289550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.289783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.316742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.317153] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.317355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.317475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.317664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.317751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.317886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 is going to be updated. [ 805.351024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.351238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.351238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.351404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.351546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.361035] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: IN_PROGRESS for 2s [ 805.520195] env[65738]: INFO networking_nsxv3.common.synchronization [req-2fe6bf90-94be-4ff2-a01b-62c8b34272d7 req-91e540ff-6d04-495f-a31f-9f0d3c017fdd tempest-ServersAdminNegativeTestJSON-1268383286 tempest-ServersAdminNegativeTestJSON-1268383286-project-member] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 805.520733] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 805.521066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.521186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.521242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.522036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.522036] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.522036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.522036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.522036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.522484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.522582] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.867524] env[65738]: INFO networking_nsxv3.common.synchronization [req-db1ce6e6-7fe3-4fb1-a530-745bcc5a708d req-f0f460b4-5b72-4bf1-8064-1098fe7bee10 service nova] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 805.867698] env[65738]: INFO networking_nsxv3.common.synchronization [req-db1ce6e6-7fe3-4fb1-a530-745bcc5a708d req-f0f460b4-5b72-4bf1-8064-1098fe7bee10 service nova] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 805.867832] env[65738]: INFO networking_nsxv3.common.synchronization [req-db1ce6e6-7fe3-4fb1-a530-745bcc5a708d req-f0f460b4-5b72-4bf1-8064-1098fe7bee10 service nova] Enqueued Resource ID: 965480dd-8154-43e9-9e24-eadc9c16f968 with Priority: HIGHEST for action port [ 805.868090] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_rules [ 805.868220] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 805.868317] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 965480dd-8154-43e9-9e24-eadc9c16f968 with Priority: HIGHEST for action port [ 805.868870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.868991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.869098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.869756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.869756] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.871209] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.871453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.871523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.871707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.871866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.871961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.872110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.872272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.872272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.872397] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.873700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-965480dd-8154-43e9-9e24-eadc9c16f968 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.873842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.874765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.878709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.878758] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('965480dd-8154-43e9-9e24-eadc9c16f968',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.024107] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.371942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.372318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.374594] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.380594] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 965480dd-8154-43e9-9e24-eadc9c16f968 with status ACTIVE [ 806.380924] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.381304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.381304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.381869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.381869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.381869] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.381869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.381869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.382233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.382233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.382303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.382778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.382778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.382778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.382778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.382778] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 965480dd-8154-43e9-9e24-eadc9c16f968 is going to be updated. [ 806.405558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.405713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.405783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.406014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.406211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.406434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-965480dd-8154-43e9-9e24-eadc9c16f968" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.527047] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.877705] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.029955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.029955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.030245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.031028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.031028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.031028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 807.078216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.078216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.078216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.078216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.078216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.088889] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 807.371497] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 in Status: SUCCESS [ 807.371697] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33ab54d8-f174-4187-9e64-2cd39cd90273 deletion is rescheduled due to dependency. [ 807.371808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33ab54d8-f174-4187-9e64-2cd39cd90273" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.382779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.383158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.383158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.383258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.383343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.383446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 is going to be created. [ 807.416602] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.416787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.416951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.417083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.417237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.429305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: UNINITIALIZED for 2s [ 809.099235] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 809.099538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.131608] env[65738]: INFO networking_nsxv3.common.synchronization [req-99f6a094-d7ab-482b-823a-b2025bebeb0d req-d9107894-ac7c-4409-976a-a27ee77a2838 tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 809.132163] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 809.132506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.132933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.132933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.132933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.133103] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.133184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.133241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.133386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.133462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.133549] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.442592] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: SUCCESS [ 809.442876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.443124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.443375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.443583] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.443741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.443842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.444057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.444144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.444257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.444376] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.482959] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.482959] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.483173] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.483481] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.484077] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.484244] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.484455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.484694] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.484884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.485092] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.485556] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.485556] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.485556] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.485556] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.486066] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.486066] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.506851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.506851] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.506851] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.507779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.507779] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-377f6a2e-439c-4a7f-a084-7ac110fe33a1 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.507779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.507972] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.508450] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.508450] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('377f6a2e-439c-4a7f-a084-7ac110fe33a1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.635801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.635959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.636267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.636382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.636503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.636825] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.637189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.637304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.637752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.637752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.637752] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 already deleted. [ 809.637919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.947193] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.011042] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.011272] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.011396] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.011675] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.011821] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.011972] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 377f6a2e-439c-4a7f-a084-7ac110fe33a1 not found, creating... [ 810.012272] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.012471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.012591] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.012811] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.012944] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.013247] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.013406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.013522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.013723] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.013851] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.013989] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 377f6a2e-439c-4a7f-a084-7ac110fe33a1 is going to be created. [ 810.034804] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.035043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.035309] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.035447] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.035682] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.035926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.449827] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d59d770-c36e-45a8-b32b-e4620ef23233: rpc.has_security_group_logging(os_id): False [ 810.468717] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.468931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.468931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.469145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.469232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.469474] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.469575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.469638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.469788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.469862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.469971] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 is going to be created. [ 810.533209] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.533209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.533209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.533209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.534535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.545122] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: IN_PROGRESS for 2s [ 810.812460] env[65738]: INFO networking_nsxv3.common.synchronization [req-99f6a094-d7ab-482b-823a-b2025bebeb0d req-5436ea03-2301-44cd-96d1-300f60e86508 service nova] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_rules [ 810.812598] env[65738]: INFO networking_nsxv3.common.synchronization [req-99f6a094-d7ab-482b-823a-b2025bebeb0d req-5436ea03-2301-44cd-96d1-300f60e86508 service nova] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 810.812735] env[65738]: INFO networking_nsxv3.common.synchronization [req-99f6a094-d7ab-482b-823a-b2025bebeb0d req-5436ea03-2301-44cd-96d1-300f60e86508 service nova] Enqueued Resource ID: 377f6a2e-439c-4a7f-a084-7ac110fe33a1 with Priority: HIGHEST for action port [ 810.814801] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_rules [ 810.814801] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 810.814801] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377f6a2e-439c-4a7f-a084-7ac110fe33a1 with Priority: HIGHEST for action port [ 810.815010] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.815133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.815198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.815476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.815551] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.817463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.817581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.817652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.817826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.817980] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.818092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.818152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.818492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821053] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.821053] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-377f6a2e-439c-4a7f-a084-7ac110fe33a1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.821053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.821053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821053] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('377f6a2e-439c-4a7f-a084-7ac110fe33a1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.323907] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.323907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.323907] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 377f6a2e-439c-4a7f-a084-7ac110fe33a1 with status ACTIVE [ 811.324822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.324822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.324822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.324822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.324822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.325135] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.325135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.325135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.325404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.325544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.327427] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.327427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.327427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.327427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.327427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.327427] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 377f6a2e-439c-4a7f-a084-7ac110fe33a1 is going to be updated. [ 811.331109] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.367874] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.367874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.367874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.368657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.368851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.369109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-377f6a2e-439c-4a7f-a084-7ac110fe33a1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.463042] env[65738]: INFO networking_nsxv3.common.synchronization [None req-fe78381c-bb5c-4052-9044-c702a8e0f844 None None] Enqueued Resource ID: 23cd22f4-78a2-4bd4-896d-ded2f53382f6 with Priority: HIGHEST for action port [ 811.464109] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23cd22f4-78a2-4bd4-896d-ded2f53382f6 with Priority: HIGHEST for action port [ 811.464245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-23cd22f4-78a2-4bd4-896d-ded2f53382f6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.464565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23cd22f4-78a2-4bd4-896d-ded2f53382f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.464565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23cd22f4-78a2-4bd4-896d-ded2f53382f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.464923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23cd22f4-78a2-4bd4-896d-ded2f53382f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.465022] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23cd22f4-78a2-4bd4-896d-ded2f53382f6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.834198] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.967227] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23cd22f4-78a2-4bd4-896d-ded2f53382f6 [ 811.967503] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.967650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.967773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.967942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.968079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.968180] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23cd22f4-78a2-4bd4-896d-ded2f53382f6 already deleted. [ 811.968600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23cd22f4-78a2-4bd4-896d-ded2f53382f6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.338218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.338375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.338444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.338663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.339500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.339500] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be created. [ 812.367327] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.367327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.367630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.367630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.367864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.383432] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: UNINITIALIZED for 2s [ 812.562704] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: SUCCESS [ 812.563269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.588014] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5929a4ee-a262-4f32-9e60-176784236ffe tempest-ServersV294TestFqdnHostnames-941903243 tempest-ServersV294TestFqdnHostnames-941903243-project-member] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 812.588014] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 812.589058] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.589477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.591908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.591908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.591908] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.688737] env[65738]: INFO networking_nsxv3.common.synchronization [None req-57d5f0b5-665a-46c1-94aa-939997fb804c tempest-ServersV294TestFqdnHostnames-941903243 tempest-ServersV294TestFqdnHostnames-941903243-project-member] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 812.689802] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 812.690177] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.690302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.123106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.123106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.123106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.123106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.123106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.123106] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b already deleted. [ 813.123106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.123742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.123742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.123742] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.652276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.652276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.652276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.652276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.652276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.652276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b already deleted. [ 813.652276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.183189] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e88e9f12-6a38-4c85-b8dd-eb86a222c28e None None] Enqueued Resource ID: 6bad2e34-0748-482c-89ae-f085aa91a081 with Priority: HIGHEST for action port [ 814.184245] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bad2e34-0748-482c-89ae-f085aa91a081 with Priority: HIGHEST for action port [ 814.184789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bad2e34-0748-482c-89ae-f085aa91a081 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.184993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bad2e34-0748-482c-89ae-f085aa91a081" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.185182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bad2e34-0748-482c-89ae-f085aa91a081" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.185798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bad2e34-0748-482c-89ae-f085aa91a081" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.185798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bad2e34-0748-482c-89ae-f085aa91a081',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.395548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 814.397654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.397654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.397654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.397654] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.397654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.397654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.398077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.398200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.398411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.398411] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.688626] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bad2e34-0748-482c-89ae-f085aa91a081 [ 814.688940] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.689074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.689145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.689355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.689452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.689549] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bad2e34-0748-482c-89ae-f085aa91a081 already deleted. [ 814.689632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bad2e34-0748-482c-89ae-f085aa91a081" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.902520] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.902734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.902807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.903102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.903300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.903416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.903473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.903684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.903788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.903878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.904075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.904202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.904263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.905020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.905020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.905020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.905020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.905020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.906771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.906906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.907025] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.118399] env[65738]: INFO networking_nsxv3.common.synchronization [req-05b72fd7-5763-4d2b-b0e2-0d82a3c10053 req-38803988-4e93-4007-9ac6-0a0b2aa9d114 tempest-AttachInterfacesV270Test-567602934 tempest-AttachInterfacesV270Test-567602934-project-member] Enqueued Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 815.118991] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGHEST for action security_group_members [ 815.119363] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.119543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.119644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.119919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.120110] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.120213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.120269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.120431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.120515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.120610] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.409343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05: rpc.has_security_group_logging(os_id): False [ 815.429226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.429329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.429398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.429613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.429705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.429892] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.429989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.430080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.431071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.431216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.431521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.431632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.431717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.431855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.431935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.432192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.432294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.432355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.433047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.433047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433047] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be created. [ 815.507291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.507490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.507564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.507777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.507958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.522473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 815.623954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.624741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.624741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.624741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.624741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.624939] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.626250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.626479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.627694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.627694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.627694] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ace770a2-a23c-4a11-9747-3be56def5369 is going to be updated. [ 815.667411] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.668636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.668636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.668636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.668636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.679419] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: IN_PROGRESS for 2s [ 816.395353] env[65738]: INFO networking_nsxv3.common.synchronization [req-1083d6e3-d673-46d1-8692-e8a9a6e1c127 req-973124b0-c789-4f9d-b1f4-68fa824da7ce tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 816.395955] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 816.396354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.396436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.396480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.396716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.396821] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.396933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.397030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.397117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.397194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.397439] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.901790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.902086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.902166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.902428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.902560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.902770] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.902883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.902990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.903216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.903305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.903397] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be updated. [ 816.936111] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.936275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.936322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.936512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.936679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.947500] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: IN_PROGRESS for 2s [ 817.536629] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 817.536922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.689548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ace770a2-a23c-4a11-9747-3be56def5369 in Status: SUCCESS [ 817.689674] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ace770a2-a23c-4a11-9747-3be56def5369 deletion is rescheduled due to dependency. [ 817.689733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.957624] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 818.957995] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 deletion is rescheduled due to dependency. [ 818.957995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.855467] env[65738]: INFO networking_nsxv3.common.synchronization [req-549d8b1d-02d7-46d1-8eaa-7e09bb874cf1 req-72af06dc-fa4c-45b4-8ccb-b220125bbbea tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 820.856695] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 820.856695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.858469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.858539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.858780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.858946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.859066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.859130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.859276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.859359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.859453] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.361832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.362086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.362086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.362286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.362374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.362592] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.362760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.362822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.362976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.363065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.363152] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 821.392429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.392695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.392782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.393014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.393186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.404769] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 823.416818] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 823.417198] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 deletion is rescheduled due to dependency. [ 823.417198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.180039] env[65738]: INFO networking_nsxv3.common.synchronization [req-96cdaf33-455c-461f-b9a1-51d0247b13a4 req-843bceaa-578c-4efc-b1de-68089c7b4ee1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 824.180039] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 824.180039] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.180039] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.180039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.180039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.494160] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.494160] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.494160] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.495170] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.495414] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.496237] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.496391] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.496482] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.496587] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.496719] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.517377] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.517712] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.517712] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.517852] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.518105] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-42516f98-c6d8-45a3-ac09-b381b3343d98 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.518271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.518424] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.518734] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.518869] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42516f98-c6d8-45a3-ac09-b381b3343d98',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.682547] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.682713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.682783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.683025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.683119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.683347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.683405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.683486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.683639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.683687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.683769] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff already deleted. [ 824.683851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.021817] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.022095] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.022298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.022592] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.022897] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.023118] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 42516f98-c6d8-45a3-ac09-b381b3343d98 not found, creating... [ 825.023428] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.023599] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.023728] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.023977] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.024140] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.024457] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.024616] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.024794] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.025167] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.025316] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.025449] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 is going to be created. [ 825.047338] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.047593] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.047678] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.048066] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.048323] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.048558] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.766295] env[65738]: INFO networking_nsxv3.common.synchronization [req-96cdaf33-455c-461f-b9a1-51d0247b13a4 req-5f5f65a5-95e5-4788-a4fa-43c4aab077d2 service nova] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 825.766558] env[65738]: INFO networking_nsxv3.common.synchronization [req-96cdaf33-455c-461f-b9a1-51d0247b13a4 req-5f5f65a5-95e5-4788-a4fa-43c4aab077d2 service nova] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 825.766599] env[65738]: INFO networking_nsxv3.common.synchronization [req-96cdaf33-455c-461f-b9a1-51d0247b13a4 req-5f5f65a5-95e5-4788-a4fa-43c4aab077d2 service nova] Enqueued Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 825.767147] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 825.767315] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 825.767426] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 825.767712] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.767835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.767899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.768572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.768662] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.769558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.769676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.769745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.769920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.770088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.770182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.770241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.770377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.770458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.770550] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.771804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-42516f98-c6d8-45a3-ac09-b381b3343d98 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.771804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.771804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.771960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.771994] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42516f98-c6d8-45a3-ac09-b381b3343d98',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.274442] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.275582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.275713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.275858] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42516f98-c6d8-45a3-ac09-b381b3343d98 with status ACTIVE [ 826.276381] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.276381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.276381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.276381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.276679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.276679] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.276801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.276801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.276917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.277101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.277286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.277382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.277441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.277566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.277637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.277715] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 is going to be updated. [ 826.299864] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.300031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.300093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.300515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.300515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.300647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.780600] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.934607] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3d0baf8-9fbf-424b-a3cd-c16ef3419c70 req-2f130109-05eb-44be-8072-0f11d95e0cd0 tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 826.936213] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 826.936213] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.936213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.936213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.936213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.936213] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.936213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.936577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.936577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.937031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.937031] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.264065] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.264272] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.264396] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.264668] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.266440] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.267253] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.267412] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.267686] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.267835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.268086] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.268302] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.268390] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.268440] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.268696] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.268696] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.268824] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.282815] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.282989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.283202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.283319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.283504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.283504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be created. [ 827.290032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.290259] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.290404] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.290581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.290937] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-0d9c93e7-931a-4729-a1c7-e122cfdac52b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.291140] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.291261] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.291623] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.291765] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9c93e7-931a-4729-a1c7-e122cfdac52b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.312196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.312344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.312847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.312847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.312847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: UNINITIALIZED for 2s [ 827.439621] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.794271] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.794586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.794716] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.795086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.795266] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.795539] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 0d9c93e7-931a-4729-a1c7-e122cfdac52b not found, creating... [ 827.795861] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.796042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.796161] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.796764] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.796927] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.797843] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.798038] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.798163] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.798383] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.798516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.798658] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 0d9c93e7-931a-4729-a1c7-e122cfdac52b is going to be created. [ 827.821649] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.821900] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.821998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.822264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.822484] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.822705] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.943008] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.448271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.448271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.448271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.448271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.448271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.448271] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be updated. [ 828.488955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.488955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.488955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.488955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.488955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.500207] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 828.552396] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3d0baf8-9fbf-424b-a3cd-c16ef3419c70 req-e26ca43e-2e41-4ca7-bdee-7bdc68c16a57 service nova] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_rules [ 828.552685] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3d0baf8-9fbf-424b-a3cd-c16ef3419c70 req-e26ca43e-2e41-4ca7-bdee-7bdc68c16a57 service nova] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 828.552857] env[65738]: INFO networking_nsxv3.common.synchronization [req-c3d0baf8-9fbf-424b-a3cd-c16ef3419c70 req-e26ca43e-2e41-4ca7-bdee-7bdc68c16a57 service nova] Enqueued Resource ID: 0d9c93e7-931a-4729-a1c7-e122cfdac52b with Priority: HIGHEST for action port [ 828.553447] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_rules [ 828.553661] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 828.553804] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d9c93e7-931a-4729-a1c7-e122cfdac52b with Priority: HIGHEST for action port [ 828.554062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.554228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.554268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.554440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.554587] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.555511] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.555608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.555846] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d9c93e7-931a-4729-a1c7-e122cfdac52b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.555984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.556047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.556202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.556283] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9c93e7-931a-4729-a1c7-e122cfdac52b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.057645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.057918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.058032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d9c93e7-931a-4729-a1c7-e122cfdac52b with status ACTIVE [ 829.058224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.058335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.058401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.058609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.058699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.058868] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.058965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.059348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.059348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.059348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.059594] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.059594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.059594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.059731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.059770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.059838] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d9c93e7-931a-4729-a1c7-e122cfdac52b is going to be updated. [ 829.085701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.085701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.085701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.085701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.085701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.085701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d9c93e7-931a-4729-a1c7-e122cfdac52b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.337443] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 829.337664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.338054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.338141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.338360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.338481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.338539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.338696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.338776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.338863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.339633] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.765651] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-ff3122a5-4bd7-491c-a56d-e03b5e626ccc tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 829.766307] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 829.766643] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.766777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.766845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.767154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.767321] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.767417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.767478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.767631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.767715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.767809] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.841990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.842205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.842255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.842604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.842800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.842800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.843092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.843251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.843344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.843396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.843536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.843762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.843820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.843951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.844030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.844120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.844197] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.164217] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.164217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.164217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.164217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.164217] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.164217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.164909] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.164979] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.165149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.165365] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.165476] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.165580] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.165730] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.165836] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.165971] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.166182] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.187103] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.187308] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.187451] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.187642] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.187981] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-af28835e-e482-4bd1-b435-f3d688bdc190 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.188217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.188406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.188739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.188887] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af28835e-e482-4bd1-b435-f3d688bdc190',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.270552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.270717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.270792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.271032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.271096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.271294] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.271388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.271491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.271587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.271660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.271744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d already deleted. [ 830.271823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.346515] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 830.368922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.369127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.369199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.369416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.369504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.369731] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.369827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.369888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.370064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.370120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.370288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.370389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.370451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.370620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.370703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.370805] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.370912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.370965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.371123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.371196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.371275] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be created. [ 830.435490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.435490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.435490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.435670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.435891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.449360] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 830.510995] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 830.510995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.510995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.511856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.512233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.512405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.512460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.512680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.512742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.512843] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.692532] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.692852] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.693473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.693473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.693473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.693678] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port af28835e-e482-4bd1-b435-f3d688bdc190 not found, creating... [ 830.693829] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.693975] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.694104] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.694333] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.694458] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.694747] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.694943] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.695171] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.695439] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.695568] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.695771] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: af28835e-e482-4bd1-b435-f3d688bdc190 is going to be created. [ 830.723847] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.724016] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.724133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.724416] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.724629] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.724853] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.015576] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.472256] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-a2fbccad-a716-4c1f-90c3-f4917af004ff service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 831.472548] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-a2fbccad-a716-4c1f-90c3-f4917af004ff service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 831.472587] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-a2fbccad-a716-4c1f-90c3-f4917af004ff service nova] Enqueued Resource ID: af28835e-e482-4bd1-b435-f3d688bdc190 with Priority: HIGHEST for action port [ 831.473142] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 831.473254] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 831.473355] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af28835e-e482-4bd1-b435-f3d688bdc190 with Priority: HIGHEST for action port [ 831.473635] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.473755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.473816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.474497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.474541] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.475452] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.475590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.475636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.475801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.476082] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.476185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.476243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.476705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.476800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.476894] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.477708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-af28835e-e482-4bd1-b435-f3d688bdc190 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.478872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.478872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.478872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.478872] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af28835e-e482-4bd1-b435-f3d688bdc190',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.518527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.979342] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.980955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.981108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.981637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af28835e-e482-4bd1-b435-f3d688bdc190 with status ACTIVE [ 831.982292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.982292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.982292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.982660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.982743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.983025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.983153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.983212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.983467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.983533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.983736] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.983845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.984219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.984503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.984610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.984728] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af28835e-e482-4bd1-b435-f3d688bdc190 is going to be updated. [ 832.011680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.011855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.011927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.012199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.012352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.012534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af28835e-e482-4bd1-b435-f3d688bdc190" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.020553] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.020756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.020756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.021012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.021107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.021213] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be updated. [ 832.067335] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.067582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.067582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.067752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.067922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.078923] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 832.465414] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 832.465733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.484401] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.549194] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-ebbef3e2-83f4-44ae-b13d-841658115a15 tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 832.549755] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 832.550492] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.550492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.933415] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.933610] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.933736] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.934707] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.935185] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.935469] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.935681] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.936273] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.936379] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.937149] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.937149] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.937264] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.937300] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.938547] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.938547] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.938547] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.965835] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.965835] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.965835] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.965835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.965835] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-9bc0998f-833c-4a97-b507-6fab27279655 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.965835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.965835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.965835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.965835] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc0998f-833c-4a97-b507-6fab27279655',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.987483] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.987483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.987483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.987483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.987773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.987859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be created. [ 833.029113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.029113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.029113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.029113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.029373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.042895] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: UNINITIALIZED for 2s [ 833.470044] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.470788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.470788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.470788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.471254] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.471254] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 9bc0998f-833c-4a97-b507-6fab27279655 not found, creating... [ 833.471362] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.471473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.474032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.474032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.474032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.474032] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.474032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.474032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.474353] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.474353] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.474470] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 9bc0998f-833c-4a97-b507-6fab27279655 is going to be created. [ 833.503083] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.503083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.503083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.503083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.503083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.505431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.593323] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 833.593323] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 833.593960] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 833.593960] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 833.594198] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.594499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.594499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.594637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.594920] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.594920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.595118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.595179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.595297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.595392] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.596509] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.596631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.596695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.596942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.597134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.597502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.597502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.597502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.597652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.597652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.651654] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_rules [ 833.651878] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 833.652223] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 833.652223] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 833.652365] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b2e0bca-beeb-4f2f-8092-60f342f46d9a req-9cc0de24-392b-4c09-a1a9-a6c35255e386 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 833.653311] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_rules [ 833.653451] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 833.653586] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 833.653696] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 833.653835] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 833.654187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.654313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.654385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.654708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.654847] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.655882] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.656341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.656341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.656578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.657168] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.658272] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-42516f98-c6d8-45a3-ac09-b381b3343d98 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.658371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.658371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.658595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.658660] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42516f98-c6d8-45a3-ac09-b381b3343d98',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.660827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.660964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.661682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.661682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.089723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 834.089723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.089913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.090269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.090572] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.090636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.090636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.090811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.090921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.090972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.091078] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.099180] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.100898] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.159227] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.159227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.164500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.164500] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42516f98-c6d8-45a3-ac09-b381b3343d98 with status ACTIVE [ 834.164500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.164500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.164500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.165498] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.165498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.165498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 is going to be updated. [ 834.191961] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.192182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.192628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.192748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.193114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.193369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.206489] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-9f412654-2cd4-48b0-b159-2fb90d6eb4be service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 834.206702] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-9f412654-2cd4-48b0-b159-2fb90d6eb4be service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 834.206882] env[65738]: INFO networking_nsxv3.common.synchronization [req-f2a7635a-8108-4c16-93c3-15cbcdf22778 req-9f412654-2cd4-48b0-b159-2fb90d6eb4be service nova] Enqueued Resource ID: 9bc0998f-833c-4a97-b507-6fab27279655 with Priority: HIGHEST for action port [ 834.207592] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 834.207813] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 834.208273] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc0998f-833c-4a97-b507-6fab27279655 with Priority: HIGHEST for action port [ 834.209018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.209129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.209380] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.209469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.209651] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc0998f-833c-4a97-b507-6fab27279655 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.209751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.209815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.210093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.210187] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc0998f-833c-4a97-b507-6fab27279655',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.216426] env[65738]: INFO networking_nsxv3.common.synchronization [None req-578afa0e-40e5-49ae-8c7b-60f063fc0b87 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 834.216915] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 834.217247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.217338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.218052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.218340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.218428] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.324129] env[65738]: INFO networking_nsxv3.common.synchronization [None req-7560dc55-4e1e-44df-9444-f5e78804f8ea tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 834.324129] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 834.324129] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.324129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.519390] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 834.519700] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 834.519700] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 834.520273] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 834.520478] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 834.520478] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 834.520779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.520890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.521347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.521347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.521347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.521630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.521730] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.521803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.521856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.522014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.522158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.522207] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.523063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.523283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.572720] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_rules [ 834.572805] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 834.572948] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_rules [ 834.573099] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 834.573227] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 834.573376] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 834.573682] env[65738]: INFO networking_nsxv3.common.synchronization [req-5119894f-46fe-4de3-906a-7de8f789c6d7 req-1d80ef9c-f860-47b6-88e5-85ce1c1d20c1 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 834.574166] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_rules [ 834.574308] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_rules [ 834.574404] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 834.574496] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 with Priority: HIGHEST for action port [ 834.574608] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 834.574650] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 834.574763] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 834.575157] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.575294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.575365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.575629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.575730] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.576873] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.576994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.577231] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.577723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.577955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-42516f98-c6d8-45a3-ac09-b381b3343d98 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.578104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.578172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.578359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.578845] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42516f98-c6d8-45a3-ac09-b381b3343d98',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.580887] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.580984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.581244] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.581335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.581561] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.581633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.593849] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.593988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.594071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594443] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.594546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.594608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.594960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.595185] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.595310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.595377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.595649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.595802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.595902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.596175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.596253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.596290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.596377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.596463] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.601897] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.602626] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.713985] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bc0998f-833c-4a97-b507-6fab27279655 with status ACTIVE [ 834.713985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.714171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.714171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.714336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.714462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.714659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.714753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.714813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.714966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.715071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.715260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.715351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.715409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.715542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.715612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.715691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bc0998f-833c-4a97-b507-6fab27279655 is going to be updated. [ 834.742958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.742958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.742958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.742958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.743224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.743314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc0998f-833c-4a97-b507-6fab27279655" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.744950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.745245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.745319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.745541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.745628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.745722] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee already deleted. [ 834.746256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.746256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.746256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.746439] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.025102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.054928] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 835.055235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.055440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.056429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.056429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.056429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.056643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.057307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.057307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.057307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.057307] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.058486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.059044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.059256] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.059408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.059455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.059596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.059683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.059769] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.082484] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42516f98-c6d8-45a3-ac09-b381b3343d98 with status ACTIVE [ 835.082484] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.082484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.082484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.082484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.082779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.082779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.082779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.082890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.082976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.083064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.083247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.083333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.083386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.083523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.083595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.083677] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42516f98-c6d8-45a3-ac09-b381b3343d98 is going to be updated. [ 835.085277] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.085408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.098682] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05: rpc.has_security_group_logging(os_id): False [ 835.104819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.104945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.105085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.105258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.105354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.105451] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be created. [ 835.106869] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.107090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.107090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.107253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.107959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.107959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 835.119349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.119604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.119604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.119756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.119825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.119973] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.120229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.120634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.120634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.120634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.120840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.120840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.120840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.121056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.121116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.121255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.121371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.121451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.121528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.121606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.121684] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be updated. [ 835.123487] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.123647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.123647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.123791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.123925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.124080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42516f98-c6d8-45a3-ac09-b381b3343d98" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.135391] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.135586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.135586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.135781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.135941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.139656] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.139811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.139855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.140040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.140213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.148454] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: UNINITIALIZED for 2s [ 835.149195] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 835.212300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.212639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.212639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.212836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.213063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.254025] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 835.302179] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.302325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.305407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.305407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.305407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.305407] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee already deleted. [ 835.305407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.424925] env[65738]: INFO networking_nsxv3.common.synchronization [req-005c5d92-bf3f-4881-9e86-44f8c6a99f0b req-68136e14-9651-4653-bc65-64a5006059e9 tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 835.424925] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 835.424925] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.424925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.424925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.425432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.426081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.426081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.426081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.426394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.426394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.426513] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.529259] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.562796] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.562796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.562796] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.822448] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.822680] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.822818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.823172] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.823644] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.823644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.824787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.824787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.824787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.824787] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.824787] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.825178] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.825178] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.825248] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.825352] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.825989] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.848159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.848334] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.848483] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.848714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.849112] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.849298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.849424] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.849754] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.849888] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90c6c33-0d9d-4a79-905e-68f96d7d8ae5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.930746] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.930960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.931058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.931364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.931498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.931788] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.931923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.932053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.932275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.932380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.932499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b already deleted. [ 835.932608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.034268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.034268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.034470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.034526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.034762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.034762] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff is going to be created. [ 836.061734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.061895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.061945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.062170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.062342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.069574] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.076518] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: UNINITIALIZED for 2s [ 836.352669] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.352935] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.353045] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.353355] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.353498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.353656] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 not found, creating... [ 836.353940] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.354164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.354202] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.354377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.354492] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.354807] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.354906] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.355023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.355321] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.355490] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.355540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 is going to be created. [ 836.377260] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.377520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.377520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.377933] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.378187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.378424] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.574559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.574559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.574559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.574559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.574559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.574559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 836.608247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.608424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.608552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.608710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.608850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.619535] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 837.107629] env[65738]: INFO networking_nsxv3.common.synchronization [req-005c5d92-bf3f-4881-9e86-44f8c6a99f0b req-55f951ec-e4f2-454d-9950-ab8d3e5e1761 service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 837.107810] env[65738]: INFO networking_nsxv3.common.synchronization [req-005c5d92-bf3f-4881-9e86-44f8c6a99f0b req-55f951ec-e4f2-454d-9950-ab8d3e5e1761 service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 837.107922] env[65738]: INFO networking_nsxv3.common.synchronization [req-005c5d92-bf3f-4881-9e86-44f8c6a99f0b req-55f951ec-e4f2-454d-9950-ab8d3e5e1761 service nova] Enqueued Resource ID: a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 with Priority: HIGHEST for action port [ 837.108517] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 837.108736] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 837.108736] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 with Priority: HIGHEST for action port [ 837.112142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.112350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.112425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.112651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.112724] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.113802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.113923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.113923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.114830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.114830] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.114830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.114830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.114830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.114830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.114830] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.115464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.115572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.115632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.115795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.115890] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90c6c33-0d9d-4a79-905e-68f96d7d8ae5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.160499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 837.160718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.161198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.161414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.161595] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.161708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.161771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.161912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.162037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.162186] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.163496] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 837.163668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.163813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.163978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.164153] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.164258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.164320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.164457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.164533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.164619] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.269128] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 837.269466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.618024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 with status ACTIVE [ 837.618468] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.618582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.618647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.618917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.619048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.620027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.620027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.620027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.620451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.620451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.620451] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a90c6c33-0d9d-4a79-905e-68f96d7d8ae5 is going to be updated. [ 837.621688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.621816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.622012] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.644377] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.644573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.644621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.644828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.644994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.645249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a90c6c33-0d9d-4a79-905e-68f96d7d8ae5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.666040] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.667126] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.090404] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: SUCCESS [ 838.090788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.091065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.091356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.095197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.095197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.095197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.095197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.095197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.095197] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.125674] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.171075] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.171075] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.211172] env[65738]: INFO networking_nsxv3.common.synchronization [req-319e27e0-7cca-4945-b78a-7bd02bf77037 req-ba391ee7-867e-414b-9a6b-ae3354f33fb3 tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 838.211912] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 838.212324] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.212479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.568187] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.568402] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.568525] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.568785] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.569508] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.569635] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.569832] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.570108] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.570360] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.571275] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.571457] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.571558] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.571704] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.571852] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.571988] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.572588] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.598450] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.598635] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.598772] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.599099] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.599330] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-13745fdb-2a0b-4950-96e0-0211595e2a3a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.599467] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.599588] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.599928] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.600113] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13745fdb-2a0b-4950-96e0-0211595e2a3a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.601139] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.627460] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 838.627725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.628329] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.628480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.628558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.628774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.628857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.628946] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be created. [ 838.629919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.630127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.630255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.630356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.630468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.630556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.630629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.630717] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.652622] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.652862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.652952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.653205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.653371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.664000] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: UNINITIALIZED for 2s [ 838.672847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.673193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.673193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.673315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.673460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.673460] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be updated. [ 838.675525] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.675525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.675525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.675525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.675525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.675525] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 838.725207] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.725723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.725723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.725994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.726175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.728580] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.728580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.740310] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 838.741102] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 839.108295] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.108295] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 13745fdb-2a0b-4950-96e0-0211595e2a3a not found, creating... [ 839.108295] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.108295] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.108949] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.108949] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.108949] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.114557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.114557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.114557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 13745fdb-2a0b-4950-96e0-0211595e2a3a is going to be created. [ 839.115186] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.133287] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.136628] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.136628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.136628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.136628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.136628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.137082] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.617420] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.617604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.617686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.617905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.617997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.618131] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff is going to be updated. [ 839.640504] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.660454] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.660637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.660687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.660997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.661175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.674087] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: IN_PROGRESS for 2s [ 839.899016] env[65738]: INFO networking_nsxv3.common.synchronization [req-319e27e0-7cca-4945-b78a-7bd02bf77037 req-dbcc0370-0552-4676-bf0b-03ed80f418fc service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 839.899016] env[65738]: INFO networking_nsxv3.common.synchronization [req-319e27e0-7cca-4945-b78a-7bd02bf77037 req-dbcc0370-0552-4676-bf0b-03ed80f418fc service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 839.899016] env[65738]: INFO networking_nsxv3.common.synchronization [req-319e27e0-7cca-4945-b78a-7bd02bf77037 req-dbcc0370-0552-4676-bf0b-03ed80f418fc service nova] Enqueued Resource ID: 13745fdb-2a0b-4950-96e0-0211595e2a3a with Priority: HIGHEST for action port [ 839.899549] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 839.899925] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 839.899925] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13745fdb-2a0b-4950-96e0-0211595e2a3a with Priority: HIGHEST for action port [ 839.900343] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.900823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.901646] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.901738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.902017] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-13745fdb-2a0b-4950-96e0-0211595e2a3a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.902173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.902173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.902351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.902452] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13745fdb-2a0b-4950-96e0-0211595e2a3a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.142941] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.143175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.143257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.143707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.143707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.143707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 840.174967] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.174967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.174967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.174967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.174967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.183437] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 840.407993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13745fdb-2a0b-4950-96e0-0211595e2a3a with status ACTIVE [ 840.407993] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.407993] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.407993] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.407993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13745fdb-2a0b-4950-96e0-0211595e2a3a is going to be updated. [ 840.433526] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.433661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.433722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.433939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.434091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.434256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13745fdb-2a0b-4950-96e0-0211595e2a3a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.629731] env[65738]: INFO networking_nsxv3.common.synchronization [req-ec475c27-c3a8-4f5b-b31d-419577f70d2d req-d4b8b7fe-55d5-493c-988b-46bc103e645d tempest-ServersTestBootFromVolume-696029730 tempest-ServersTestBootFromVolume-696029730-project-member] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 840.631545] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGHEST for action security_group_members [ 840.632781] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.633062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.633633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.633976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.634261] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.634447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.634577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.634836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.634987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.635148] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.676285] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.676285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.676285] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.676285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.677690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.678059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.678356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.678526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.679215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.679432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.679627] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.753111] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 840.753242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.753372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.753586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.753789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.753918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.753983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.754479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.754479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.754479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.754479] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.756197] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 840.756379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.757034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.757034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.757034] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.757034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.757034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.757286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.757286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.757286] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.758171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.758245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.759388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.759388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.759522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.759630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.759698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.759751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.759846] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.761082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.761150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.761266] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.761370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.761432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.761567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.761642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.761764] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.141192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.141373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.141618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.141618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.164427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.165360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.165360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.165360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.165360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.165360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.165360] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 is going to be updated. [ 841.184894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.185137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.185251] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.195154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.195593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.195730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.197670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.197832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.207568] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: IN_PROGRESS for 2s [ 841.261987] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.262285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.262365] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.263595] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.264541] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.685663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: SUCCESS [ 841.685663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.686052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.686052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.686207] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.686334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.686408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.686562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.686634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.686714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.686808] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.688163] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.766140] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.769861] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b178e-30ff-4875-afce-3f12db8c8904: rpc.has_security_group_logging(os_id): False [ 841.773375] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.796059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.796255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.796334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.796552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.796635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.796890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.797132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.797132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.797217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.797279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.797363] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be created. [ 841.868526] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.868745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.868745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.868900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.869072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.883482] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 842.194853] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 842.195474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.195474] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.196587] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.196740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.197074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.197149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.197311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.197443] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 842.198779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.199017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.199251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.199395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.199479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.199663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.199771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.199879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.200127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.200386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.200436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.200641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.200819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.200973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.201067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.201285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.201441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.201558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.201695] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.236100] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.236336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.236450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.236773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.236983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.248736] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 842.277116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.277116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.277116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.277116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.277400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.277400] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 842.278587] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.278694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.278758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.279914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.280031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.280159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be updated. [ 842.337298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.337441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.337552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.337713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.337877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.344050] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.344050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.344050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.344326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.344464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.359926] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 842.365756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 842.707724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ce4c090-b8b5-42a5-846b-5d88bb5236ff: rpc.has_security_group_logging(os_id): False [ 842.707724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b13c9f1-4035-4155-8f11-de49c18c0a4d: rpc.has_security_group_logging(os_id): False [ 842.730301] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.730301] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.730301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.730301] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff is going to be created. [ 842.733095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.733095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.733460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.733862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.734132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.734461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.734719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.734876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.735167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.735374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.736120] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.736359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.736516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.736780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.737030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.737352] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.737577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.737727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.737958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.738168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.738364] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be created. [ 842.821027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.821027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.821027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.821027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.821027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.823829] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.823829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.823829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.824021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.824138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.860607] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 842.861433] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: IN_PROGRESS for 2s [ 843.219145] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: IN_PROGRESS for 4s [ 843.898041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 843.898347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.898607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.898894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.898894] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.259788] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 844.260020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.260201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.260424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.260616] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.260733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.260798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.260952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.261070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.261141] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.377098] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 844.377319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.377492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.377706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.377895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.378031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.378099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.378347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.378347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.378449] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.381373] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 844.381581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.381775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.381969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.382165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.382265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.382377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.382997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.382997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.382997] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.400954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.400954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.406553] env[65738]: INFO networking_nsxv3.common.synchronization [req-62d3856e-0a7e-4771-b83b-276853bac3b3 req-468c1755-c531-41ab-a5ba-a96c37a73ca1 tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 844.407199] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 844.407347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.407563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.765275] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.877986] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 844.877986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.877986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.877986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.878295] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.881930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: SUCCESS [ 844.882208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.884706] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.885872] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.942331] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.942331] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.942331] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.942331] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.942331] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.942331] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.943162] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.943529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.943790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.944132] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.944355] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.948043] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.948043] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.948043] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.948043] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.948043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.967945] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.968163] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.968245] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.968407] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-302" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.968727] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-7de64718-e109-41a2-9afd-15f7da3e2642 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.968884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.969043] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.973025] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.973025] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de64718-e109-41a2-9afd-15f7da3e2642',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.231281] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 in Status: SUCCESS [ 845.231487] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 deletion is rescheduled due to dependency. [ 845.231616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.268158] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.383138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.383138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.383138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.383138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.383451] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.383501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.383554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.384401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.384401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.384401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.384401] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.389871] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.390502] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.473023] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.473422] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.473422] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.473652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.473781] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.474031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 7de64718-e109-41a2-9afd-15f7da3e2642 not found, creating... [ 845.474503] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474783] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.474938] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.475232] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.475460] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.475823] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.475987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.476117] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.476357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.476526] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.476707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 7de64718-e109-41a2-9afd-15f7da3e2642 is going to be created. [ 845.511031] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.511031] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.511031] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.511031] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.511031] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.511031] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.770866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.771133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.771237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.771496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.771625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.771756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 845.806388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.806617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.806739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.807079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.807242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.819407] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 845.887208] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.887413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.887475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.887796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.887975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.888120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.888159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.888337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.888487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.888659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.888659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.888761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.888894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.889023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.889191] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.889191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.889348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.889480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.889480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.889629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.889763] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.892825] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.892953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.893091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.893232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.893342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.893423] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be updated. [ 845.894668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.894780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.895173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.895173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.895173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.895173] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 845.931242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.931444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.931444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.931663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.931808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.933886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.934100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.934100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.934261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.934388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.945496] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 845.946281] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 846.162883] env[65738]: INFO networking_nsxv3.common.synchronization [None req-1955d2e5-a13f-481b-b3e6-318cceae5761 None None] Enqueued Resource ID: 2c41c33e-ce00-489a-868d-c35623dac79c with Priority: HIGHEST for action port [ 846.163424] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c41c33e-ce00-489a-868d-c35623dac79c with Priority: HIGHEST for action port [ 846.164589] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c41c33e-ce00-489a-868d-c35623dac79c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.164589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c41c33e-ce00-489a-868d-c35623dac79c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.164589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c41c33e-ce00-489a-868d-c35623dac79c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.164589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c41c33e-ce00-489a-868d-c35623dac79c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.164589] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c41c33e-ce00-489a-868d-c35623dac79c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.251247] env[65738]: INFO networking_nsxv3.common.synchronization [req-62d3856e-0a7e-4771-b83b-276853bac3b3 req-5adc7f51-f449-4c3e-9b6e-34f4efc7badc service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 846.251775] env[65738]: INFO networking_nsxv3.common.synchronization [req-62d3856e-0a7e-4771-b83b-276853bac3b3 req-5adc7f51-f449-4c3e-9b6e-34f4efc7badc service nova] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 846.252064] env[65738]: INFO networking_nsxv3.common.synchronization [req-62d3856e-0a7e-4771-b83b-276853bac3b3 req-5adc7f51-f449-4c3e-9b6e-34f4efc7badc service nova] Enqueued Resource ID: 7de64718-e109-41a2-9afd-15f7da3e2642 with Priority: HIGHEST for action port [ 846.252787] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_rules [ 846.252898] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 846.253088] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7de64718-e109-41a2-9afd-15f7da3e2642 with Priority: HIGHEST for action port [ 846.254025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.254459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.254538] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.254701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.254878] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7de64718-e109-41a2-9afd-15f7da3e2642 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.254995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.255070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.255283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.255505] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de64718-e109-41a2-9afd-15f7da3e2642',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.392013] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b13c9f1-4035-4155-8f11-de49c18c0a4d: rpc.has_security_group_logging(os_id): False [ 846.416044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.416293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.416293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.416552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.416641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.416888] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.417246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.417333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.417481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.417555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.417762] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.417865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.417927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.418746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.418856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.419076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.419172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.419249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.419513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.419588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.419679] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 846.493862] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.494145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.494145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.494398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.494572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.518024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 846.667469] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c41c33e-ce00-489a-868d-c35623dac79c [ 846.670423] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.670547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.670547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.672126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.672126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.672126] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c41c33e-ce00-489a-868d-c35623dac79c already deleted. [ 846.672126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c41c33e-ce00-489a-868d-c35623dac79c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.757866] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7de64718-e109-41a2-9afd-15f7da3e2642 with status ACTIVE [ 846.758084] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.758343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.758343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.758538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.758635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.758839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.758964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.759061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.759279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.759399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.759620] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.759692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.759764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.759929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.760041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.760153] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7de64718-e109-41a2-9afd-15f7da3e2642 is going to be updated. [ 846.784765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.784908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.785061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.785220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.785546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.785607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7de64718-e109-41a2-9afd-15f7da3e2642" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.804220] env[65738]: INFO networking_nsxv3.common.synchronization [req-af0d9d32-9a31-4a7d-8d01-6dd2a8a37933 req-53dfa070-8c1b-4af0-b295-24ee17b08c5d tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 846.804392] env[65738]: INFO networking_nsxv3.common.synchronization [req-44efa171-cccb-41b3-8fd1-0db594362742 req-62b11585-ae0c-49b3-886e-76a99bd6f92c tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 846.804870] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 846.805180] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.805292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.805437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.805615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.805774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.805869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.805928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.806107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.806192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.806287] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.267390] env[65738]: INFO networking_nsxv3.common.synchronization [req-1864ae50-9eb5-4873-958d-ee029613f574 req-c689983e-5f11-4967-bafa-5549fca202dd tempest-ServerAddressesNegativeTestJSON-1769830517 tempest-ServerAddressesNegativeTestJSON-1769830517-project-member] Enqueued Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 847.268026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 847.268344] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.268469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.268538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.268799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.268963] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.271197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.271197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.271197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.271197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.271197] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.313330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.313448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.313693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.313874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.314133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.314291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.314423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.315033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.315033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.315033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.315033] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 847.361236] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.363107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.363107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.363107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.363107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.371670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 847.649944] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.650166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-286" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.650290] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-286" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.650630] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-286" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.650895] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.651077] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.651194] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.651427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.651578] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.651772] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.651916] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.655148] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.655332] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.655492] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.655618] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.655836] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.684042] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.684042] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.684042] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.684042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-286" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.684042] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-0bff2750-c7f7-4920-800e-b07412a2d7d8 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.684042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.684042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.684042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.684042] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bff2750-c7f7-4920-800e-b07412a2d7d8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.774074] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.778050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.778277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.778579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.778695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.778986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.779129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.779202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.779414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.779505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.779603] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d already deleted. [ 847.779699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.832640] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 847.832892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.833110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.833345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.833541] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.833661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.833719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.833865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.833959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.834048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.834205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.834308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.834363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.834467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.834624] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.834744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.834819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.834964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.835054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.835768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.835920] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.837095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.837618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.837618] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.837618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.837754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.837962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.838082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.838197] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.958764] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 847.958997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.959723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 847.959892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.960057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.960268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.960463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.960571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.960648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.960781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.962506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.962506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.962506] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.964264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.964451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.964630] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.964738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.964796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.964941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.965072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.965134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.965256] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.965347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.965427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.965563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.965700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.965791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.965847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.965975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.966057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966236] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.189304] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.189529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.189653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.189946] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.190085] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.190240] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 0bff2750-c7f7-4920-800e-b07412a2d7d8 not found, creating... [ 848.190510] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.190714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.190829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.191070] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.191201] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.191955] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.192161] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.192322] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.193019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.193019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.193019] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 0bff2750-c7f7-4920-800e-b07412a2d7d8 is going to be created. [ 848.227724] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.227937] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.228086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.228397] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.228636] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.228875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.341708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e49fe7b-0238-41d4-921e-d91254c2761b: rpc.has_security_group_logging(os_id): False [ 848.342106] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.381135] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.381319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.381384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.381619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.381730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.382000] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.382131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.382194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.382334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.382418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.382597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.382701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.382765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.382903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.382974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.385086] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.385216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.385290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.385494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.385597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.385699] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be created. [ 848.468182] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.469637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 848.475224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.475224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.475224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.475224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.475224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.493312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.493667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.493765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.493984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.494099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.494409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.494522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.494583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.494787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.494915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.495389] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.496610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.496933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.496983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.497042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.497448] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.497634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.497743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.498029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.499670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.499873] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 848.501981] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 848.532437] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 848.532437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.604616] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.605042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.605042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.605607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.605607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.644493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 848.848267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.978370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b178e-30ff-4875-afce-3f12db8c8904: rpc.has_security_group_logging(os_id): False [ 849.001749] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.001749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.001912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.002599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.002791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.003113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.003234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.003361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.003547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.003634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.003726] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be updated. [ 849.037794] env[65738]: INFO networking_nsxv3.common.synchronization [req-1864ae50-9eb5-4873-958d-ee029613f574 req-abd0cc73-25f8-465c-bc54-a14a164f67ae service nova] Enqueued Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_rules [ 849.038249] env[65738]: INFO networking_nsxv3.common.synchronization [req-1864ae50-9eb5-4873-958d-ee029613f574 req-abd0cc73-25f8-465c-bc54-a14a164f67ae service nova] Enqueued Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 849.038620] env[65738]: INFO networking_nsxv3.common.synchronization [req-1864ae50-9eb5-4873-958d-ee029613f574 req-abd0cc73-25f8-465c-bc54-a14a164f67ae service nova] Enqueued Resource ID: 0bff2750-c7f7-4920-800e-b07412a2d7d8 with Priority: HIGHEST for action port [ 849.039383] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_rules [ 849.039551] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 849.039650] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bff2750-c7f7-4920-800e-b07412a2d7d8 with Priority: HIGHEST for action port [ 849.039992] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.040145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.040218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.040531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.040616] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.044617] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.044772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.044886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.045130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.045371] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.045488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.045488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.046434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.046434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.046434] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.046968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bff2750-c7f7-4920-800e-b07412a2d7d8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.047102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.047166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.047321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.047501] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bff2750-c7f7-4920-800e-b07412a2d7d8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.081390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.081671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.081671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.081824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.081984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.098371] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 849.251184] env[65738]: INFO networking_nsxv3.common.synchronization [req-581885bf-8470-4ad2-ae36-45a7a02edfa3 req-3d7e04b0-49c6-4f8c-a3d2-fb90e7fb4752 tempest-ServersAdminNegativeTestJSON-1268383286 tempest-ServersAdminNegativeTestJSON-1268383286-project-member] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 849.252911] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGHEST for action security_group_members [ 849.253179] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.253562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.253562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.253698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.253764] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.255267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.255267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.255267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.255267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.255267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.353315] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.353611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.353766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.354033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.354170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.354300] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 849.385482] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 849.385700] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d deletion is rescheduled due to dependency. [ 849.385866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.387223] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.387347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.387410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.387643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.387828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.396928] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 849.552534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bff2750-c7f7-4920-800e-b07412a2d7d8 with status ACTIVE [ 849.552775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.552911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.552986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.553223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.553320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.553509] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.553638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.553706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.556205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.556205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.556205] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bff2750-c7f7-4920-800e-b07412a2d7d8 is going to be updated. [ 849.558395] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.559024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.559024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.560927] env[65738]: INFO networking_nsxv3.common.synchronization [None req-df2074ec-cefc-4a84-b47f-2955740a42f0 None None] Enqueued Resource ID: a3dbebfb-1304-493f-8c4f-af13f63a207f with Priority: HIGHEST for action port [ 849.561602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3dbebfb-1304-493f-8c4f-af13f63a207f with Priority: HIGHEST for action port [ 849.563704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3dbebfb-1304-493f-8c4f-af13f63a207f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.563704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3dbebfb-1304-493f-8c4f-af13f63a207f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.563704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3dbebfb-1304-493f-8c4f-af13f63a207f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.563704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3dbebfb-1304-493f-8c4f-af13f63a207f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.563704] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3dbebfb-1304-493f-8c4f-af13f63a207f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.587181] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.587181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.587181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.587181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.587181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.587581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bff2750-c7f7-4920-800e-b07412a2d7d8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.757614] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.757614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.757614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.757893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.757930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.758699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.758699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.758699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.758699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.758699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.758699] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be updated. [ 849.791484] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.791703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.791820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.792060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.793391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.810421] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: IN_PROGRESS for 2s [ 850.059668] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.066025] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3dbebfb-1304-493f-8c4f-af13f63a207f [ 850.066310] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.066609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.066784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.067035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.067109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.067237] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3dbebfb-1304-493f-8c4f-af13f63a207f already deleted. [ 850.067294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3dbebfb-1304-493f-8c4f-af13f63a207f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.516101] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 850.516418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.516677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.516963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517080] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.564930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.565113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.565186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.565723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.565723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.565723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d is going to be created. [ 850.597196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.597349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.597424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.597640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.598929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.610408] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: UNINITIALIZED for 2s [ 850.659424] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 850.659721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.659935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.660187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.660278] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.019974] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.020190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.119214] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 851.119214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.162349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.162547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.162675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.162927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.164681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.164681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.164681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164681] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.226188] env[65738]: INFO networking_nsxv3.common.synchronization [req-d338f50a-0799-4811-867d-95b291828070 req-f19bcf01-e1a4-43ce-b813-c46aca91524d tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 851.226803] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 851.227159] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.227272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.227337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.227595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.227708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.227833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.227905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.228341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.228462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.228574] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.409405] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 851.409405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.409405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.409633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.409756] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.409868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.409932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.410125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.410207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.410307] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.659983] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.659983] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.659983] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.660476] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.660476] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.660476] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.660611] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.660810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.660946] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.661168] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.661276] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.661381] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.661487] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.661595] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.661703] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.661838] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.667917] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.668124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.668205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.668474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.668671] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.668764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.668823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.668977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.669146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.669261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.669437] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.669527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.669590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.669722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.669855] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.669940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.670021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.670147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.670217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.670280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.670370] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.683164] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.683332] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.683465] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.683634] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-230" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.684069] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.684257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.684380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.684711] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.684845] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04f0871-7f72-4e5b-b5df-a60ebe8b3871',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.732267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.822720] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c141272-ba24-462d-b6ed-4f263864d60c in Status: SUCCESS [ 851.822900] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c deletion is rescheduled due to dependency. [ 851.822993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913154] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.172954] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 852.187298] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.187560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.187625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.188190] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.188346] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.188500] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port d04f0871-7f72-4e5b-b5df-a60ebe8b3871 not found, creating... [ 852.188766] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.188929] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.189054] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.189280] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.189408] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.190295] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.190517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.190671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.190986] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.191166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.191290] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: d04f0871-7f72-4e5b-b5df-a60ebe8b3871 is going to be created. [ 852.193078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.193191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.193238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.193451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.193568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.193782] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.193880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.193940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.194101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.194176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.194352] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.194443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.194500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.194636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.194709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.194885] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.194975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.195046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.195196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.195248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.195326] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 852.225192] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.225192] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.225192] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.225192] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.225403] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.225798] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.234888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.297981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.298335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.298335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.298542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.298685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.345342] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 852.415932] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.623223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: SUCCESS [ 852.623425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.623620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.623838] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.624098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.624317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.624317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.624429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.625246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625246] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.737217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.737644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.737644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.737913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.738086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.738276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 852.778918] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.779127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.779181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.779430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.779583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.791850] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 852.921172] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.921172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.921172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.921172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.921172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.921172] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 852.952173] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.952173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.952173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.952330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.952692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.967108] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 853.031915] env[65738]: INFO networking_nsxv3.common.synchronization [req-d338f50a-0799-4811-867d-95b291828070 req-0e82d72f-758f-4bbb-ba26-6c4bc9704c31 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 853.032118] env[65738]: INFO networking_nsxv3.common.synchronization [req-d338f50a-0799-4811-867d-95b291828070 req-0e82d72f-758f-4bbb-ba26-6c4bc9704c31 service nova] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 853.032308] env[65738]: INFO networking_nsxv3.common.synchronization [req-d338f50a-0799-4811-867d-95b291828070 req-0e82d72f-758f-4bbb-ba26-6c4bc9704c31 service nova] Enqueued Resource ID: d04f0871-7f72-4e5b-b5df-a60ebe8b3871 with Priority: HIGHEST for action port [ 853.032923] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_rules [ 853.033087] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 853.033188] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04f0871-7f72-4e5b-b5df-a60ebe8b3871 with Priority: HIGHEST for action port [ 853.033613] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.033613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.033766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.033839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.033912] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.035269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.035500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.035757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.035940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.035940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.036200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.036267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04f0871-7f72-4e5b-b5df-a60ebe8b3871',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.126928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.127830] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.127830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.128448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.128448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.128448] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.128448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.128448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.128448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.128706] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.128706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.128706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.128844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.129456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.129456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.129456] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.415752] env[65738]: INFO networking_nsxv3.common.synchronization [req-568a8049-33b0-4887-b65e-5488a650bc4f req-ab5f2e35-4d2b-40e6-95ae-399b92a2079c tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 853.416899] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 853.417271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.417417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.417525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.417644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.417803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.417899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.417987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.418111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.418192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.418272] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.538088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.538231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.538421] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d04f0871-7f72-4e5b-b5df-a60ebe8b3871 with status ACTIVE [ 853.538595] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.538706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.538784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.539011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.539105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.539299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.539450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.539547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.539776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.539899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.540169] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.540281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.540345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.540488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.540562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.540644] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d04f0871-7f72-4e5b-b5df-a60ebe8b3871 is going to be updated. [ 853.564014] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.564190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.564256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.564502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.564637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.564800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04f0871-7f72-4e5b-b5df-a60ebe8b3871" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.631833] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fedc2c17-2f50-459d-88ff-941dd856cb4d: rpc.has_security_group_logging(os_id): False [ 853.672251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.672457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.672565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.672841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.672968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.673286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.673418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.673524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.673729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.673831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.674106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.674242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.674326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.674625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.674731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.674969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.675105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.675203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.675411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.675533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.675664] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d is going to be created. [ 853.765823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.766190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.766190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.766369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.767793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.781177] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: IN_PROGRESS for 2s [ 853.920904] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.364245] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 854.368024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.424102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.806041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 854.806686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.806686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.806686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.806899] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.808527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.808625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.808809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.808982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.809474] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.932073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.932073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.932073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.932073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.932073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.932073] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 854.970897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.971151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.971262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.971514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.971692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.984993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 854.987115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.987115] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 854.987115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.987470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.987532] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.987658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.987730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.987930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.988036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.988127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.988217] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.313714] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.492539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.492899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.493104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.493486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494926] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.494926] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494926] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.495969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.495969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.495969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.495969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.495969] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.803200] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: SUCCESS [ 855.803430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816357] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.998183] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e49fe7b-0238-41d4-921e-d91254c2761b: rpc.has_security_group_logging(os_id): False [ 856.020080] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.020080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.023034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.023442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.023580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.024187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.024187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.024187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.025582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.025582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.025582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.026174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.026174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.026174] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 856.100025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.100025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.100025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.100025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.100025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.117029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 856.336580] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.336580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.336580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.336580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.336580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.336580] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 856.372024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.372024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.372024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.372024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.372024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.389944] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 856.969411] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3b20a115-2252-458a-9ea2-acef22fd0b4b tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 856.969411] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 856.969411] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.970169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.970465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.972381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.972381] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.000688] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 857.000975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.080125] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e3bdeb6f-861b-44fb-9041-c5697bcbade9 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 857.081617] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 857.081617] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.081617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.494517] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.494644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.494697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.494931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.495034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.495128] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 already deleted. [ 857.495210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.495371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.495746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.495746] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.022349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.022557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.022586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.022936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.023110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.023257] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 already deleted. [ 858.023382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.134707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 858.134981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.135192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.135416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.135508] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.402032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 858.402032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.402032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.402575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.402575] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.402950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.402950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.402950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.403198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.403198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.403317] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.638116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.638491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.638491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.638597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.638747] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.638950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.639035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.639445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.639565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.640678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.640678] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.758042] env[65738]: INFO networking_nsxv3.common.synchronization [req-ee4540c4-ea5a-4368-a671-5b780b4d1e79 req-9fbcc981-fed3-4e21-9cfa-d8e7ba701a4e tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 858.758612] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 858.758954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.762863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.762966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.763237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.763519] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.763769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.763931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.764208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.764338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.764471] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.905665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.905995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.906158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.906413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.906694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.906935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.907011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.907201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.907287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.907374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.907530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.907620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.907866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.907866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.907939] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.908037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.908094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.908223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.908293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.908381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.908450] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.142850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.143176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.143176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.143489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.143489] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.143980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.144085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.144259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.144379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.144436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.144589] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.144701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.144761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.144912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.145088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.145184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.145229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.145363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.145440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.145524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.145606] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.187242] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.187443] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.187565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.187837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.188263] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.188452] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.188566] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.188788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.188924] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.189137] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.189247] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.189352] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.189467] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.189548] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.189647] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.189778] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.209828] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.209828] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 859.210046] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.210118] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-57" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.210443] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-6820f67a-4a6d-472a-b949-07e5b2313ecb taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.210615] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.210731] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.211123] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.211264] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6820f67a-4a6d-472a-b949-07e5b2313ecb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.266476] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.266759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.266887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.267136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.267229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.267438] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.267600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.267600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.267744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.267819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.267934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be deleted. [ 859.302956] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.303465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.303559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.303806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.303890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.303990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.410715] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84a7a11-9309-4895-a6a4-e6d1f1dddb0b: rpc.has_security_group_logging(os_id): False [ 859.431017] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.431195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.431263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.431781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.431885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.432125] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.432242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.432477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.432554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.432767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.432862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.433085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.433158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.433425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.433484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.433525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.433662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.433833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.434070] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 859.534369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.534633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.534760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.535094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.535387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.570943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 859.648514] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e49fe7b-0238-41d4-921e-d91254c2761b: rpc.has_security_group_logging(os_id): False [ 859.670320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.670503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.670550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.670801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.670923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.671253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.671362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.671453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.671608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.671689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.671883] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.672061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.672130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.672291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.672368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.672565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.672665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.672742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.672867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.672946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.673063] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 859.714413] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.714709] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.715415] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.715415] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.715643] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.715849] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 6820f67a-4a6d-472a-b949-07e5b2313ecb not found, creating... [ 859.716199] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.716400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.716535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.716811] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.716964] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.717418] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.717624] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.717777] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.718111] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.718304] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.718535] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 6820f67a-4a6d-472a-b949-07e5b2313ecb is going to be created. [ 859.742297] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.742595] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.742772] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.743166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.743778] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.744220] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.770312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.770312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.770312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.770475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.770576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.788287] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 860.330875] env[65738]: INFO networking_nsxv3.common.synchronization [req-198e98d9-a814-49f2-9121-d560dedee629 req-269a911f-5d4b-478f-9fbd-c148557bef06 tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 860.331755] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 860.333598] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.333598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.333598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.333598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.333801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.333801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.333801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.334014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.334439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.334568] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.358398] env[65738]: INFO networking_nsxv3.common.synchronization [req-198e98d9-a814-49f2-9121-d560dedee629 req-269a911f-5d4b-478f-9fbd-c148557bef06 tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 860.360027] env[65738]: INFO networking_nsxv3.common.synchronization [req-198e98d9-a814-49f2-9121-d560dedee629 req-269a911f-5d4b-478f-9fbd-c148557bef06 tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 860.360027] env[65738]: INFO networking_nsxv3.common.synchronization [req-198e98d9-a814-49f2-9121-d560dedee629 req-269a911f-5d4b-478f-9fbd-c148557bef06 tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 860.360027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 860.360027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 860.360027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 860.360027] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.360433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.360598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.361038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.361213] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.362746] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.362958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.363291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc27a62-49d2-4737-83ce-9336a2777b88 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.364611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.364611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.364611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.364611] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc27a62-49d2-4737-83ce-9336a2777b88',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.545191] env[65738]: INFO networking_nsxv3.common.synchronization [req-ee4540c4-ea5a-4368-a671-5b780b4d1e79 req-eb30fbcb-81f0-4bb4-b66c-164c7de01a74 service nova] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 860.545191] env[65738]: INFO networking_nsxv3.common.synchronization [req-ee4540c4-ea5a-4368-a671-5b780b4d1e79 req-eb30fbcb-81f0-4bb4-b66c-164c7de01a74 service nova] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 860.545191] env[65738]: INFO networking_nsxv3.common.synchronization [req-ee4540c4-ea5a-4368-a671-5b780b4d1e79 req-eb30fbcb-81f0-4bb4-b66c-164c7de01a74 service nova] Enqueued Resource ID: 6820f67a-4a6d-472a-b949-07e5b2313ecb with Priority: HIGHEST for action port [ 860.546080] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_rules [ 860.546350] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 860.546549] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6820f67a-4a6d-472a-b949-07e5b2313ecb with Priority: HIGHEST for action port [ 860.546973] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.547260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.547482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.547795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.547964] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.550123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.550123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.550123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.550123] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.551300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6820f67a-4a6d-472a-b949-07e5b2313ecb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.551504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.551632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.551842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.551982] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6820f67a-4a6d-472a-b949-07e5b2313ecb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.839276] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.866954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.867177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.868510] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dc27a62-49d2-4737-83ce-9336a2777b88 with status ACTIVE [ 860.869070] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.869070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.869070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.869291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.869406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.869604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.869721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.869811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.869951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.870050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.870255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.870348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.870529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.870573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.870640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.870745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 is going to be updated. [ 860.898648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.898869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.898869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.899145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.899365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.899545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.054346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.054346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.054762] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.056101] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6820f67a-4a6d-472a-b949-07e5b2313ecb with status ACTIVE [ 861.056101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.056181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.056240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.056439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.056491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.056645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.057050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.057050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.057126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.057150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.057323] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.057417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.057476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.057610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.057699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.057787] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6820f67a-4a6d-472a-b949-07e5b2313ecb is going to be updated. [ 861.165021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.165021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.165021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.165212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.165359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.166405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6820f67a-4a6d-472a-b949-07e5b2313ecb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.343129] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.560041] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.590036] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 861.590036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.797401] env[65738]: INFO networking_nsxv3.common.synchronization [None req-65966f1e-f065-4927-a005-5a94c968ce74 tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 with Priority: HIGHEST for action security_group_rules [ 861.797572] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 with Priority: HIGHEST for action security_group_rules [ 861.797929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.798119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.798548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.798548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.798711] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.815232] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 861.816154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.846076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.846288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.846411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.846695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.846957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.848138] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be updated. [ 861.890272] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.890504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.891248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.891486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.891650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.907808] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 861.996366] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0f06b602-3df2-40a6-b365-0b5e754f46e7 tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 with Priority: HIGHEST for action security_group_rules [ 861.996494] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 with Priority: HIGHEST for action security_group_rules [ 861.996865] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.997012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.062362] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.062588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.062770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.062934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.063067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.063190] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be created. [ 862.090710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.090915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.090968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.091318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.091540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.105364] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: UNINITIALIZED for 2s [ 862.138027] env[65738]: INFO networking_nsxv3.common.synchronization [req-b9b16d47-141b-4492-aaee-f638d273b01a req-aa8a5f67-1104-41cd-aec6-d47090aa883c tempest-ServerAddressesNegativeTestJSON-1769830517 tempest-ServerAddressesNegativeTestJSON-1769830517-project-member] Enqueued Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 862.138572] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGHEST for action security_group_members [ 862.138896] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.139016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.139406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.139519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.139738] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.139803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.139834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.140053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.140144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.140241] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.335189] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.335189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.335189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.335974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.338114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.338114] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 already deleted. [ 862.338114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.338114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.338114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.338114] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.498469] env[65738]: INFO networking_nsxv3.common.synchronization [req-58bb15bf-7847-4a40-9d6b-be69de24427a req-7f90c3c8-a3a8-470b-9265-a196bb3c7c21 tempest-ServerActionsV293TestJSON-1184867836 tempest-ServerActionsV293TestJSON-1184867836-project-member] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 862.499437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGHEST for action security_group_members [ 862.499437] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.499579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.499579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.499828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.499895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.499991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.500086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.500212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.500297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.500417] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.646604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.646730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.646802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.647085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.647243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.647832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.647832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.647832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.647832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.647832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.647832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d is going to be updated. [ 862.679025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.679025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.679025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.679025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.679025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.689632] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: IN_PROGRESS for 2s [ 862.863314] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.863314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.863314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.863564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.863674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.863773] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4 already deleted. [ 862.863852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f9f3278-88be-4d57-8d67-ebeb6d2f6eb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.004229] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.004229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.004229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.004229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.004229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.004229] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.004229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.004469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.004469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.004720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.004720] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 is going to be updated. [ 863.037954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.038232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.038316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.038554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.038726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.053083] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: IN_PROGRESS for 2s [ 863.922047] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 863.922304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.922439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.922648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.922835] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.922944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.923017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.923171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.923245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.923363] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.933955] env[65738]: INFO networking_nsxv3.common.synchronization [req-378f6505-81bf-4f10-9fd5-6e1bf1dc91c0 req-544ebda5-ad4a-42b6-be60-5e3ad629163d tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 863.935373] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 863.935373] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.935373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.936301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.936301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.937249] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.937639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.937639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.938029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.938209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.938348] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.117294] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 864.117500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.117820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.118051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.118286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.118339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.118421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.118589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.118622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.118699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.118787] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.121101] env[65738]: INFO networking_nsxv3.common.synchronization [req-dcf44ff1-d47b-4f7b-af4d-333f4d14bded req-8972a095-8588-4cab-9bcd-8b0af3c90c7e tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 864.121507] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 864.122013] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.122121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.134724] env[65738]: INFO networking_nsxv3.common.synchronization [req-dcf44ff1-d47b-4f7b-af4d-333f4d14bded req-8972a095-8588-4cab-9bcd-8b0af3c90c7e tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 864.134895] env[65738]: INFO networking_nsxv3.common.synchronization [req-dcf44ff1-d47b-4f7b-af4d-333f4d14bded req-8972a095-8588-4cab-9bcd-8b0af3c90c7e tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 864.135045] env[65738]: INFO networking_nsxv3.common.synchronization [req-dcf44ff1-d47b-4f7b-af4d-333f4d14bded req-8972a095-8588-4cab-9bcd-8b0af3c90c7e tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 864.135673] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_rules [ 864.135805] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 864.135968] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 with Priority: HIGHEST for action port [ 864.136223] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.136324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.136514] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.136596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.136774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc27a62-49d2-4737-83ce-9336a2777b88 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.136884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.136956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.137191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.137272] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc27a62-49d2-4737-83ce-9336a2777b88',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.346028] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.346286] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.346551] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.346833] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.347255] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.347447] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.347677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.347894] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.348782] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.348782] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.348782] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.348782] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.348987] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.349087] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.349210] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.349374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.371548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.371854] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.372100] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.372371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.372823] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.373571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.373571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.373571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.373707] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179b83bd-2f46-4b2e-b690-e8a6ab32e7f1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.426029] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.441464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.441633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.441706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.442121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.442121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.442337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.442475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.442544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.442739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.442842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.442947] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be deleted. [ 864.492176] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.492336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.492404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.492654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.492748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.492868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.621987] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.639845] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dc27a62-49d2-4737-83ce-9336a2777b88 with status ACTIVE [ 864.640024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.640148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.640210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.640422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.641267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.641267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.641267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.641267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.641267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.641267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.641267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.641547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.641547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.641547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.641547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.641713] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dc27a62-49d2-4737-83ce-9336a2777b88 is going to be updated. [ 864.671924] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.672132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.672132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.672316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.672455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.672616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc27a62-49d2-4737-83ce-9336a2777b88" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.701207] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fedc2c17-2f50-459d-88ff-941dd856cb4d in Status: SUCCESS [ 864.701398] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d deletion is rescheduled due to dependency. [ 864.701518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.876762] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.877091] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.877224] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.877620] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.877852] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.878070] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 not found, creating... [ 864.878393] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.878608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.878791] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.879157] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.879771] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.880191] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.880574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.880574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.880821] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.880983] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.881636] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 is going to be created. [ 864.913028] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.913028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.913028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.913028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.913028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.913028] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.928708] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.066162] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 in Status: SUCCESS [ 865.066162] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 deletion is rescheduled due to dependency. [ 865.066162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.124663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f6f7207-78fd-4f30-bb10-327e2c3450e8: rpc.has_security_group_logging(os_id): False [ 865.142731] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.146179] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.146179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.146179] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be created. [ 865.210197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.210197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.210197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.210197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.210197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.222540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: IN_PROGRESS for 2s [ 865.431818] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.431897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.432017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.432545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.432545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.432545] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be updated. [ 865.463965] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.463965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.463965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.463965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.463965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.473439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [req-378f6505-81bf-4f10-9fd5-6e1bf1dc91c0 req-dab2c402-01c3-47ba-adb4-63200686c304 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [req-378f6505-81bf-4f10-9fd5-6e1bf1dc91c0 req-dab2c402-01c3-47ba-adb4-63200686c304 service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [req-378f6505-81bf-4f10-9fd5-6e1bf1dc91c0 req-dab2c402-01c3-47ba-adb4-63200686c304 service nova] Enqueued Resource ID: 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 with Priority: HIGHEST for action port [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 865.612576] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 with Priority: HIGHEST for action port [ 865.612576] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.612576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.612576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.613122] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.613122] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.613935] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.613935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.614064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.614229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.614394] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.614527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.614606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.615861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.615861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.615861] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.616269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.616269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.616366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.616608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.616608] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179b83bd-2f46-4b2e-b690-e8a6ab32e7f1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.118634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.118921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.118958] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 with status ACTIVE [ 866.119201] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.119321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.119389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.119591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.119679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.119847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.119941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.120010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.120171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.120248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.120432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.120525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.120583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.120718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.120788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.120883] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 179b83bd-2f46-4b2e-b690-e8a6ab32e7f1 is going to be updated. [ 866.122841] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.144260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.144395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.144466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.144676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.144812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.144973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179b83bd-2f46-4b2e-b690-e8a6ab32e7f1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.624813] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.979831] env[65738]: INFO networking_nsxv3.common.synchronization [req-60fa46a7-56e0-46af-8cf0-e4ee681de9df req-fc3f90f9-b841-419d-b82f-dc80085fb83f tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 866.979831] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 866.980116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.980803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.980896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.981149] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.981317] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.981730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.981801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.982137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.982262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.982513] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.127795] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.128452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.128635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.128852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.128946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.129059] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 867.155468] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.155611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.155680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.155893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.156152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.166263] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: UNINITIALIZED for 2s [ 867.235412] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 867.235715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.418641] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.418802] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.418802] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.419663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.421559] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.421559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.421760] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.422720] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.422720] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.422720] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.422720] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.422953] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.422953] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.423074] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.423231] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.423382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.447062] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.447062] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.447062] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.447062] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.447062] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447062] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447062] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447730] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.484461] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 867.484652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.484852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.485105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.485329] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.485445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.485511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.485663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.485742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.485872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.486018] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.487029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.487162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.487228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.487376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.487463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.487626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.487722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.487781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.487917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.487997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.488074] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 867.489129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.489298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.489445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.489544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.489627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.489788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.489863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.489949] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.515914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.515914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.515914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.516355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.516355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.526832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 867.950751] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.951149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.951398] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.951773] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.952029] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.952289] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b not found, creating... [ 867.952629] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.952829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.952952] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.953221] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.953374] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.953699] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.953854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.954015] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.954321] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.954504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.954678] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b is going to be created. [ 867.978811] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.979255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.979255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.979443] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.979670] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.979888] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.991851] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.993696] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.494329] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72af6c3f-606c-49b1-8ed2-d3711bffee90: rpc.has_security_group_logging(os_id): False [ 868.495316] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.516803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.517017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.517154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.517450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.517621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.517822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.517950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.518036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.518174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.518269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.518349] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be updated. [ 868.583725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.583859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.583936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.584169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.584311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.602807] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 868.699718] env[65738]: INFO networking_nsxv3.common.synchronization [req-60fa46a7-56e0-46af-8cf0-e4ee681de9df req-c70b7e1a-7cf3-4a5f-a570-c14554285943 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 868.699896] env[65738]: INFO networking_nsxv3.common.synchronization [req-60fa46a7-56e0-46af-8cf0-e4ee681de9df req-c70b7e1a-7cf3-4a5f-a570-c14554285943 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 868.700128] env[65738]: INFO networking_nsxv3.common.synchronization [req-60fa46a7-56e0-46af-8cf0-e4ee681de9df req-c70b7e1a-7cf3-4a5f-a570-c14554285943 service nova] Enqueued Resource ID: 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b with Priority: HIGHEST for action port [ 868.700816] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 868.700816] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 868.700968] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b with Priority: HIGHEST for action port [ 868.701262] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.701470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.701688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.701771] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.702717] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.702788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.702946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.703057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.703124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.703333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.703411] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.998997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.998997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.998997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.998997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.998997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998997] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be updated. [ 869.042999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.043178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.043245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.043460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.043613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.060927] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: IN_PROGRESS for 2s [ 869.177668] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 869.177871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.178090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.178267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.179088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.179088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.179088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.179088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.179088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.179088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.179088] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.205975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.205975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.205975] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b with status ACTIVE [ 869.205975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.205975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.205975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.206465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.206465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.206465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.206620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.206620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.206763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.206822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.206994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.207192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.207192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.207374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.207450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.207518] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b is going to be updated. [ 869.230634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.230909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.230979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.231210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.231337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.231507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e2dbb12-2bc2-4eaa-b1de-4b0cdcd91c7b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.538274] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 869.538591] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 869.538625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.539217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.539217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.539217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.539374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.539374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.540187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.540187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.540187] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.683215] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.683395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.683454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.683787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.684088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.685084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.685084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.685084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.685084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.685084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.685351] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.685351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.685435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.686385] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.686385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.686385] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.811166] env[65738]: INFO networking_nsxv3.common.synchronization [None req-4b8f61c3-35f3-46f1-a783-e15e4d5c422b tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 869.811701] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 869.812119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.812236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.812236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.812730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.812730] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.906106] env[65738]: INFO networking_nsxv3.common.synchronization [None req-6cd84a5e-eacf-4753-ba16-5fbe40639cdc tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 869.906106] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 869.906106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.906106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.042948] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.192085] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 870.198457] env[65738]: INFO networking_nsxv3.common.synchronization [req-4a3c32c1-6404-4112-90c9-59d3cd6e357b req-7750f2e9-21d0-4183-a766-d3621c99a674 tempest-AttachInterfacesUnderV243Test-428140690 tempest-AttachInterfacesUnderV243Test-428140690-project-member] Enqueued Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 870.199795] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 with Priority: HIGHEST for action security_group_members [ 870.200632] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-72af6c3f-606c-49b1-8ed2-d3711bffee90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.200632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219693] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.219693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.219693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.219693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219693] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 870.287025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.287025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.287025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.287025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.287025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.300550] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 870.351026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.351026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 already deleted. [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.351026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.351026] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.549184] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.568068] env[65738]: INFO networking_nsxv3.common.synchronization [None req-cc6960ad-1fe7-4bf3-8e54-79cf315cd230 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: e0397e78-8171-4e61-9369-17f72da397b0 with Priority: HIGHEST for action security_group_rules [ 870.568155] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0397e78-8171-4e61-9369-17f72da397b0 with Priority: HIGHEST for action security_group_rules [ 870.568504] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0397e78-8171-4e61-9369-17f72da397b0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.568627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.568692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.568952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.569598] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0397e78-8171-4e61-9369-17f72da397b0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.621774] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 870.621995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.622638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.622924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.623067] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.667310] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9d4f141a-a6b9-48d9-9d51-7e9f104918c3 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: e0397e78-8171-4e61-9369-17f72da397b0 with Priority: HIGHEST for action security_group_rules [ 870.667697] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0397e78-8171-4e61-9369-17f72da397b0 with Priority: HIGHEST for action security_group_rules [ 870.668019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0397e78-8171-4e61-9369-17f72da397b0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.668336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.876682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.877031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.877221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.877531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.877711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.877894] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 already deleted. [ 870.878067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.052455] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.052455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.052455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.052761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.052814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.057786] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 871.074231] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 in Status: SUCCESS [ 871.074231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.075409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.075708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.075950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.076196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.076304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.076511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.076699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.076825] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.093518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.093669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.093767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.093945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.094151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.097542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.097542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.097652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.097705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097779] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0397e78-8171-4e61-9369-17f72da397b0 already deleted. [ 871.097864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.098055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.098189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.098274] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0397e78-8171-4e61-9369-17f72da397b0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.104182] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 871.144126] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.144307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.144388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.144590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.145216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.145216] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be deleted. [ 871.211640] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.211640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.211779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.211936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.212045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.212169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.581087] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.581350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.581350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.581514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.581601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.581823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.581910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.581962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.582121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.582195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.582281] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 is going to be deleted. [ 871.619355] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.619527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.619567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.619767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.619850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.619940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0397e78-8171-4e61-9369-17f72da397b0 already deleted. [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0397e78-8171-4e61-9369-17f72da397b0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.624090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.624090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.624090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.624090] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72af6c3f-606c-49b1-8ed2-d3711bffee90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.125138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.125355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.125435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.125716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.126099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.126543] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.126702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.126876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.127170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.127311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.127424] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72af6c3f-606c-49b1-8ed2-d3711bffee90 already deleted. [ 872.127539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72af6c3f-606c-49b1-8ed2-d3711bffee90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.337741] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 872.337741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.119952] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 873.120341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.120384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.120602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.120823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.120946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.121021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.121188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.121270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.121428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.121494] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.310083] env[65738]: INFO networking_nsxv3.common.synchronization [req-877be6b9-4759-4a4b-b372-a0e8dfd3b3b1 req-2e0ac66a-aa74-4996-8a2c-e8e16ab7bf7d tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 873.310612] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 873.310966] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.311077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.311191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.313308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.313491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.313600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.313664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.313843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.313926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.314028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.624503] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.624915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.624915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.624915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.625102] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.625204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.625270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.625423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.625506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.625599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.625744] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.625878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.625878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.626033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.626221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.626332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.626398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.626542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.626615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.626695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.626785] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.773710] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.773966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.774633] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.775214] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.775616] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.775839] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.775998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.776316] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.776503] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.776776] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.776928] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.777093] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.777287] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.777400] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.777547] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.780769] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.806112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.806112] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.806112] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.806112] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.806333] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-efd6210d-b799-4249-a249-7456a449866c taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.806444] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.806569] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.806854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.806987] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efd6210d-b799-4249-a249-7456a449866c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.818178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.818178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.818178] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 already deleted. [ 873.818178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.133163] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 874.154890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.155118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.155118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.155377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.155612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.155890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.156013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.156093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.156348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.156436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.156648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.156775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.156815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.157014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.157121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.157374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.157488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.157543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.157703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.157771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.157856] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 874.227886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.228120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.228246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.228585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.228816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.248743] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 874.310373] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.310837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.310837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.311106] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.311261] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.311428] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port efd6210d-b799-4249-a249-7456a449866c not found, creating... [ 874.311709] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.311892] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.312055] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.312339] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.312506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.312911] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.313187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.313500] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.313662] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.313818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.314309] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: efd6210d-b799-4249-a249-7456a449866c is going to be created. [ 874.340148] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.340407] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.340711] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.340844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.341126] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.341405] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.109334] env[65738]: INFO networking_nsxv3.common.synchronization [req-93bb6f54-2a11-4225-9dd5-4a63d08e25a9 req-582c8a2c-21fa-43a7-ab87-cf8be601b1ce tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 875.112013] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 875.112769] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.112935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.113016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.113361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.113453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.113574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.113636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.113819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.113927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.114062] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.224654] env[65738]: INFO networking_nsxv3.common.synchronization [req-877be6b9-4759-4a4b-b372-a0e8dfd3b3b1 req-ce4e86d3-a5d2-4c3b-b155-8b05f698f646 service nova] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 875.224923] env[65738]: INFO networking_nsxv3.common.synchronization [req-877be6b9-4759-4a4b-b372-a0e8dfd3b3b1 req-ce4e86d3-a5d2-4c3b-b155-8b05f698f646 service nova] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 875.224957] env[65738]: INFO networking_nsxv3.common.synchronization [req-877be6b9-4759-4a4b-b372-a0e8dfd3b3b1 req-ce4e86d3-a5d2-4c3b-b155-8b05f698f646 service nova] Enqueued Resource ID: efd6210d-b799-4249-a249-7456a449866c with Priority: HIGHEST for action port [ 875.225477] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_rules [ 875.225690] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 875.225690] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd6210d-b799-4249-a249-7456a449866c with Priority: HIGHEST for action port [ 875.225958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.226086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.226138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.226416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.226620] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.227664] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.227771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.227833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.228010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.228163] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.228255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.228311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.228455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.228545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.228644] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.229452] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-efd6210d-b799-4249-a249-7456a449866c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.229531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.229567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.230111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.230111] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efd6210d-b799-4249-a249-7456a449866c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.618136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.618324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.618391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.618651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.646657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.646657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.646657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.646657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.646912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.646912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.647041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 875.680732] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.680939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.680939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.681214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.681356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.691960] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 875.731437] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.731703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.731999] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.733174] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efd6210d-b799-4249-a249-7456a449866c with status ACTIVE [ 875.733430] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.733576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.733660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.733892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.734007] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.734264] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.734341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.734422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.734606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.737067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.737067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.737067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.737067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.737067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.737067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.737067] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efd6210d-b799-4249-a249-7456a449866c is going to be updated. [ 875.767558] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.767785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.767974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.768118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.768308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.768528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efd6210d-b799-4249-a249-7456a449866c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.237970] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.271718] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 876.271718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.742614] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.743523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.743676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.743929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.744078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.744223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 is going to be created. [ 876.773047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.773202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.773279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.774031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.774031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.784761] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: UNINITIALIZED for 2s [ 877.709472] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 877.709809] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 877.709809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.799624] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: SUCCESS [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.799624] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.799624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.799624] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.301686] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.804828] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0abfdb06-6f7f-40a7-be5b-fa4298901330: rpc.has_security_group_logging(os_id): False [ 879.829559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.829893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.829893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.830186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.830300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.830629] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.830772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.830827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.831058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.831164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.831270] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 is going to be created. [ 879.907209] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.907392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.907485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.907710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.907943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.923404] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: IN_PROGRESS for 2s [ 880.226429] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 880.226595] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 881.214250] env[65738]: INFO networking_nsxv3.common.synchronization [req-b768e089-3447-4482-a667-5a93ad5059aa req-ab33e659-3ae6-4c77-b47a-90eb739d68b2 tempest-ServersV294TestFqdnHostnames-941903243 tempest-ServersV294TestFqdnHostnames-941903243-project-member] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 881.214966] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 881.215845] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.215845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.215845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.215845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.216177] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.216177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.216177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.216303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.216381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.216512] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.721568] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.721830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.721917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.722370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.722538] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.722678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.722743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.723050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.723194] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b already deleted. [ 881.723340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.795841] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.796122] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.796498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.796945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.797471] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.797739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.797869] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.798486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.798486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.798608] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.798651] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.798760] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.798870] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.798983] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.799088] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.799223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.824333] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.824572] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.824787] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.824973] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-551" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.825338] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.825526] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.825667] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.826163] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.826327] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc86ddbb-9afe-4964-8d85-fe163b3d0f7a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.938745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: SUCCESS [ 881.938745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.330403] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.330800] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.330800] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.331081] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.331198] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.331387] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port dc86ddbb-9afe-4964-8d85-fe163b3d0f7a not found, creating... [ 882.331676] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.331847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.331965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.332289] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.332445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.332762] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.332998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.333153] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.333393] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.333556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.333683] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: dc86ddbb-9afe-4964-8d85-fe163b3d0f7a is going to be created. [ 882.355947] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.356202] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.356373] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.356754] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.357037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.357298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.091383] env[65738]: INFO networking_nsxv3.common.synchronization [req-b768e089-3447-4482-a667-5a93ad5059aa req-a440241f-150d-48a1-bd9e-d2705cf5bca9 service nova] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 883.092211] env[65738]: INFO networking_nsxv3.common.synchronization [req-b768e089-3447-4482-a667-5a93ad5059aa req-a440241f-150d-48a1-bd9e-d2705cf5bca9 service nova] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 883.092211] env[65738]: INFO networking_nsxv3.common.synchronization [req-b768e089-3447-4482-a667-5a93ad5059aa req-a440241f-150d-48a1-bd9e-d2705cf5bca9 service nova] Enqueued Resource ID: dc86ddbb-9afe-4964-8d85-fe163b3d0f7a with Priority: HIGHEST for action port [ 883.093634] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_rules [ 883.093784] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 883.093902] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc86ddbb-9afe-4964-8d85-fe163b3d0f7a with Priority: HIGHEST for action port [ 883.094412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.094484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.095572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.095851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.095943] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.097347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.097563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.097693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.097909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.098088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.098195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.098263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.098415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.098501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.098800] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.099666] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.099776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.099858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.101720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.101720] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc86ddbb-9afe-4964-8d85-fe163b3d0f7a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.602438] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.604193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.604328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.604536] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc86ddbb-9afe-4964-8d85-fe163b3d0f7a with status ACTIVE [ 883.604770] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.604903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.605958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.605958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.606283] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.606283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.606401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.607023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.607023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.607023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc86ddbb-9afe-4964-8d85-fe163b3d0f7a is going to be updated. [ 883.629417] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.629742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.629843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.630072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.630209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.630379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc86ddbb-9afe-4964-8d85-fe163b3d0f7a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.109519] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.611895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.612193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.612193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.612471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.612548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.612659] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b is going to be created. [ 884.641353] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.641353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.641353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.641353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.641588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.653027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: UNINITIALIZED for 2s [ 886.667257] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: SUCCESS [ 886.667581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.667755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.667987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.668205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.668326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.668391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.668547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.668659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.668733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.668833] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.725453] env[65738]: INFO networking_nsxv3.common.synchronization [req-0b701c05-8706-431e-af32-ad44a341ffde req-d238d629-b2cc-4bb1-b0d8-f6958bd3f453 tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 886.726929] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 886.726929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.726929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.726929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.726929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.726929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.727236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.727236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.727236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.727236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.727335] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.172059] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.230914] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.676522] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fc0f4a9-1474-4292-821f-7f1aa18de95b: rpc.has_security_group_logging(os_id): False [ 887.701665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.701903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.701903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.703022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.703022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.703022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b is going to be created. [ 887.733973] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.777673] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.777843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.777843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.778547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.778547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.800455] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: IN_PROGRESS for 2s [ 888.237745] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.239024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.239024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.239024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.239024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.239024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 888.322978] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.323563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.323563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.323563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.323769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.335862] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 889.816043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: SUCCESS [ 889.816409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.359911] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 890.360232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.815678] env[65738]: INFO networking_nsxv3.common.synchronization [req-34375614-33e7-482a-8e3b-2a520aff3f72 req-c0e731a1-acd0-481e-b678-d81fbd55c2d9 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 890.816679] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 890.817020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.817103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.817164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.817451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.817633] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.817756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.817845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.818057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.818151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.818268] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.221273] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.221535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.221706] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.221985] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.222302] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.222609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.222986] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.223241] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.223390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.223674] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.223831] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.223961] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.224087] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.224203] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.224319] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.224460] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.244343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.244514] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.244686] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.244896] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.245243] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-b20a3685-54ae-4b0f-8590-45a66dd86ad3 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.245420] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.245543] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.245959] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.246153] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20a3685-54ae-4b0f-8590-45a66dd86ad3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.320594] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.320790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.320888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.321070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.321169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.321388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.321498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.321565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.321708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.321785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.321858] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee already deleted. [ 891.321938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.749304] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.749919] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.750063] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.750294] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.750588] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.750755] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port b20a3685-54ae-4b0f-8590-45a66dd86ad3 not found, creating... [ 891.751161] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.751395] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.751580] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.751879] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.752089] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.752493] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.752933] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.753136] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.753437] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.753641] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.753838] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: b20a3685-54ae-4b0f-8590-45a66dd86ad3 is going to be created. [ 891.778181] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.778428] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.778515] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.778826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.779149] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.779417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.483703] env[65738]: INFO networking_nsxv3.common.synchronization [req-34375614-33e7-482a-8e3b-2a520aff3f72 req-df74fee2-8eb6-4c2c-99aa-aa86590f9cdb service nova] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 892.483940] env[65738]: INFO networking_nsxv3.common.synchronization [req-34375614-33e7-482a-8e3b-2a520aff3f72 req-df74fee2-8eb6-4c2c-99aa-aa86590f9cdb service nova] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 892.484069] env[65738]: INFO networking_nsxv3.common.synchronization [req-34375614-33e7-482a-8e3b-2a520aff3f72 req-df74fee2-8eb6-4c2c-99aa-aa86590f9cdb service nova] Enqueued Resource ID: b20a3685-54ae-4b0f-8590-45a66dd86ad3 with Priority: HIGHEST for action port [ 892.484598] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_rules [ 892.484782] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 892.484842] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20a3685-54ae-4b0f-8590-45a66dd86ad3 with Priority: HIGHEST for action port [ 892.485177] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.485325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.485369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.485556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.485616] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.486486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.486596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.486662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.486865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.487066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.487171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.487307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.487411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.487503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.487587] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.490337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b20a3685-54ae-4b0f-8590-45a66dd86ad3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.490445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.490509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.490658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.490731] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20a3685-54ae-4b0f-8590-45a66dd86ad3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.991179] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.992288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.992412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.992568] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b20a3685-54ae-4b0f-8590-45a66dd86ad3 with status ACTIVE [ 892.992724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.993079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.993079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.993144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.993171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.993338] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.993455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.993490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.993634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.993705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.993883] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.993975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.994042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.994177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.994248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.994331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b20a3685-54ae-4b0f-8590-45a66dd86ad3 is going to be updated. [ 893.018857] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.019089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.019089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.019244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.019387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.019548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b20a3685-54ae-4b0f-8590-45a66dd86ad3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.383810] env[65738]: INFO networking_nsxv3.common.synchronization [req-fdc70227-cba7-4995-a318-ad0238784096 req-ed2a058f-211b-4616-bcfc-4dbad983a482 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 893.384411] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 893.384743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.384878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.384949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.385344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.385516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.385624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.385688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.385848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.385936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.386065] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.496354] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.711280] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.711416] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.711560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.711854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.715134] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.715433] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.715535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.715800] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.715951] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.716220] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.716398] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.716537] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.716651] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.716771] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.716901] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.717058] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.739239] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.739483] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.739575] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.739815] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-769" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.740195] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-4c7b0ffb-b81f-451b-880f-79bcb617f801 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.740400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.740610] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.741570] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.741701] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7b0ffb-b81f-451b-880f-79bcb617f801',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.889477] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.001138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.001138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.001138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.001138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.001138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.001138] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee is going to be created. [ 894.038022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.038022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.038022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.038022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.038022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.051156] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: UNINITIALIZED for 2s [ 894.244752] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.245145] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.245341] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.245652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.245827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.246039] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 4c7b0ffb-b81f-451b-880f-79bcb617f801 not found, creating... [ 894.246405] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.246601] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.246721] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.247115] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.247284] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.247608] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.247860] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.247942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.248254] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.248445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.248643] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 is going to be created. [ 894.296956] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.296956] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.297199] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.297563] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.297917] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.299525] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.393174] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.898022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.898022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.898022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.898022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.898022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.898022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 894.935462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.935462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.935462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.935462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.935462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.946248] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 895.121762] env[65738]: INFO networking_nsxv3.common.synchronization [req-fdc70227-cba7-4995-a318-ad0238784096 req-97175828-b146-4463-b42a-0dd4941a4d93 service nova] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 895.122013] env[65738]: INFO networking_nsxv3.common.synchronization [req-fdc70227-cba7-4995-a318-ad0238784096 req-97175828-b146-4463-b42a-0dd4941a4d93 service nova] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 895.122184] env[65738]: INFO networking_nsxv3.common.synchronization [req-fdc70227-cba7-4995-a318-ad0238784096 req-97175828-b146-4463-b42a-0dd4941a4d93 service nova] Enqueued Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 895.122795] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 895.122932] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 895.123516] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 895.123968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.123968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.124096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.124241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.124320] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.125225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.125321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.125519] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7b0ffb-b81f-451b-880f-79bcb617f801 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.125600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.127335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.127335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.127335] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7b0ffb-b81f-451b-880f-79bcb617f801',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.628339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.628697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.629948] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7b0ffb-b81f-451b-880f-79bcb617f801 with status ACTIVE [ 895.630196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.630336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.630538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.630620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.630704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.630911] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.631037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.631118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.631260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.631345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.631543] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.631688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.631688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.631833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.631901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.631968] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 is going to be updated. [ 895.656847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.657355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.657355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.657355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.657638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.657704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.064673] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: SUCCESS [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.067117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.067117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.067117] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.340672] env[65738]: INFO networking_nsxv3.common.synchronization [req-8e936e91-2e33-4a01-ba06-1dc4ca1c27d4 req-cf1a4830-b8f7-4b97-ab04-0ef24f7ccb14 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 896.341219] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 896.341525] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.341645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.341710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.341972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.342296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.342404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.342466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.342617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.342701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.342793] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.570098] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.686303] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.686501] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.686626] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.687019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.687308] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.687520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.687582] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.687792] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.688049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.688222] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.688332] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.688437] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.688541] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.688647] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.688750] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.688882] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.708707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.708875] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 896.709015] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.709210] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.709538] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-3b148f9c-982b-4a33-be85-ea784973c387 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.709714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.709844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.710187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.710332] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b148f9c-982b-4a33-be85-ea784973c387',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.844948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.845236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.845339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.845603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.845709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.845916] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.846023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.846100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.846278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.846356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.846444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 already deleted. [ 896.846520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.958670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 896.958897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.959080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.959340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.959537] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.959656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.959721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.959878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.959982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.960111] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.075730] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee: rpc.has_security_group_logging(os_id): False [ 897.101038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.101038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.101038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.101038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.101038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.101038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.101378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.101378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.101452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.101541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.101630] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee is going to be created. [ 897.177287] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.177287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.177287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.177287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.177287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.193638] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: IN_PROGRESS for 2s [ 897.216137] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.216137] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 3b148f9c-982b-4a33-be85-ea784973c387 not found, creating... [ 897.216137] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.216137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.216597] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.216597] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.216597] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.216597] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.216597] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.216864] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 3b148f9c-982b-4a33-be85-ea784973c387 is going to be created. [ 897.245206] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.245206] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.245206] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.247248] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.247248] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.247248] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.463546] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.965320] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.091520] env[65738]: INFO networking_nsxv3.common.synchronization [req-8e936e91-2e33-4a01-ba06-1dc4ca1c27d4 req-8a7fda21-6c94-4128-ba74-8b0312b28442 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 898.091894] env[65738]: INFO networking_nsxv3.common.synchronization [req-8e936e91-2e33-4a01-ba06-1dc4ca1c27d4 req-8a7fda21-6c94-4128-ba74-8b0312b28442 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 898.092428] env[65738]: INFO networking_nsxv3.common.synchronization [req-8e936e91-2e33-4a01-ba06-1dc4ca1c27d4 req-8a7fda21-6c94-4128-ba74-8b0312b28442 service nova] Enqueued Resource ID: 3b148f9c-982b-4a33-be85-ea784973c387 with Priority: HIGHEST for action port [ 898.092999] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 898.093149] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 898.093252] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b148f9c-982b-4a33-be85-ea784973c387 with Priority: HIGHEST for action port [ 898.093977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.094634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.094634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.094634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.095088] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.095990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.096133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.096404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.096732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.097201] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.097201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.097352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.097572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.097795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.098056] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.100048] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b148f9c-982b-4a33-be85-ea784973c387 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.100284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.100428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.100823] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b148f9c-982b-4a33-be85-ea784973c387',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.468211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.468924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.469042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.469282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.469379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.469489] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 898.504885] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.505090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.505166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.505460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.506578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.518271] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 898.605465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.605600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.605866] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.606831] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b148f9c-982b-4a33-be85-ea784973c387 with status ACTIVE [ 898.607074] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.607223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.607260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.607603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.607656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.607845] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.607893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.607967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.610853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.610853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.610853] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.611103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.611103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.613253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.613362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.613465] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b148f9c-982b-4a33-be85-ea784973c387 is going to be updated. [ 898.641881] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.642083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.642154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.642316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.642456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.642627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b148f9c-982b-4a33-be85-ea784973c387" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.115475] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.210032] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: SUCCESS [ 899.210032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.229097] env[65738]: INFO networking_nsxv3.common.synchronization [req-f458ab23-55e9-474c-9da5-f490fda4c99b req-c4867b60-20b5-467d-89ef-8b3667dfc325 tempest-MigrationsAdminTest-1101907697 tempest-MigrationsAdminTest-1101907697-project-member] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 899.233029] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGHEST for action security_group_members [ 899.233029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.233029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.233029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.233029] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.618334] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.618546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.618647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.618949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.619106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.619224] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be created. [ 899.650866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.651080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.651229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.651512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.651733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.666154] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: UNINITIALIZED for 2s [ 899.734079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.734634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.734634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.735952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.735952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.735952] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.735952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.735952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.735952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.736199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.736199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be updated. [ 899.802319] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.802587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.802652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.802927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.803185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.817940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: IN_PROGRESS for 2s [ 900.529374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 900.529879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.529879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.530202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.530444] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.530660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.530736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.530976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.533113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.533113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.533113] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.039043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.039043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.039043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.039043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.039466] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.039466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.039466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.039631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.039758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.040020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.040193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.040285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.040363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.040556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.042047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.042047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.042047] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.076265] env[65738]: INFO networking_nsxv3.common.synchronization [req-91951c97-1a30-4328-b5e6-da7bc8655026 req-d3aa7248-2f10-464b-ae37-1620f93b1525 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 901.078719] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 901.079075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.079213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.079267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.079569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.079904] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.079904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.080033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.080103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.080193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.080344] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.532032] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.532032] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.532574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.532574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.532995] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.533250] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.533417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.534649] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.534847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.535337] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.535475] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.535579] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.535718] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.535814] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.535914] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.536160] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.544275] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 901.566540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.566540] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.566540] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.566886] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.566984] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-4f9493c5-04d0-4263-97a2-c30c2250d8c0 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.567226] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.567356] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.567698] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.567862] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9493c5-04d0-4263-97a2-c30c2250d8c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.570238] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.570407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.570517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.570627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.570731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.571040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.571145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.571217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.571394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.571448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.571856] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.571856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.571856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.572034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.572034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.572217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.572322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.572322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.572448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.572516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.572645] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 901.586226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.586446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.586581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.587645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.587645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.587645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.587645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.587645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.588302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.588302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.588302] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 already deleted. [ 901.588302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.663787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.664030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.664141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.664415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.664650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.677811] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 901.678144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.678352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.678618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.678919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.679109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.679201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.679507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.679647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.679742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.679850] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.690258] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 901.839288] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e974415d-6bf2-41ac-b8e6-2817575b8abd in Status: SUCCESS [ 901.839555] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd deletion is rescheduled due to dependency. [ 901.839633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.070190] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.070531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.070624] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.070840] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.070994] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.071171] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 4f9493c5-04d0-4263-97a2-c30c2250d8c0 not found, creating... [ 902.071451] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.071617] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.071734] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.072076] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.072318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.072609] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.072769] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.072883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.073108] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.073240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.073384] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 4f9493c5-04d0-4263-97a2-c30c2250d8c0 is going to be created. [ 902.098994] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.099367] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.099563] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.100070] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.100411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.100782] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.182727] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.182986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.183061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.183285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.183494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.183632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.183688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.183874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.184016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.184162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.184393] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.184490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.184548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.184705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.184903] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.185080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.185159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.185245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.185320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.185407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.185493] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.688040] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 902.709821] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.709821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.709821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.713744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.713993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.714339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.714499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.714585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.714766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.714925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.715202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.715342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.715395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.715563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.715653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.715875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.716015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.716076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.716265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.716360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.716555] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be created. [ 902.795547] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.795715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.795787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.796043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.796217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.815204] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 902.856982] env[65738]: INFO networking_nsxv3.common.synchronization [req-91951c97-1a30-4328-b5e6-da7bc8655026 req-b0beefba-afac-4ba8-8969-e410025fdf23 service nova] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 902.857322] env[65738]: INFO networking_nsxv3.common.synchronization [req-91951c97-1a30-4328-b5e6-da7bc8655026 req-b0beefba-afac-4ba8-8969-e410025fdf23 service nova] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 902.857500] env[65738]: INFO networking_nsxv3.common.synchronization [req-91951c97-1a30-4328-b5e6-da7bc8655026 req-b0beefba-afac-4ba8-8969-e410025fdf23 service nova] Enqueued Resource ID: 4f9493c5-04d0-4263-97a2-c30c2250d8c0 with Priority: HIGHEST for action port [ 902.858190] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_rules [ 902.858392] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 902.858529] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f9493c5-04d0-4263-97a2-c30c2250d8c0 with Priority: HIGHEST for action port [ 902.858827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.859020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.859136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.859389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.859479] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.861109] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.861109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.861109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.861410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.861410] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.861609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.861702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.861878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.861967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.862094] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.863395] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f9493c5-04d0-4263-97a2-c30c2250d8c0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.864578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.864578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.864707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.864751] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9493c5-04d0-4263-97a2-c30c2250d8c0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.158763] env[65738]: INFO networking_nsxv3.common.synchronization [req-57956869-d015-4aba-ba20-34c7caff2cc5 req-7b1c110c-7ee1-4549-9b0f-e8cbaa90d9bc tempest-ServersTestManualDisk-1852094496 tempest-ServersTestManualDisk-1852094496-project-member] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 903.159247] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGHEST for action security_group_members [ 903.159648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.159772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.159850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.160731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.160941] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.161136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.161292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.161482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.161643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.161806] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.368839] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.369955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.370130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.370279] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f9493c5-04d0-4263-97a2-c30c2250d8c0 with status ACTIVE [ 903.370428] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.370532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.370594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.370817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.370902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.371076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.371183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.371284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.371514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.371618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.371822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.371912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.371968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.372584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.372662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.372743] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f9493c5-04d0-4263-97a2-c30c2250d8c0 is going to be updated. [ 903.401482] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.401720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.401720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.401932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.402301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.402301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f9493c5-04d0-4263-97a2-c30c2250d8c0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.664828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.665124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.665219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.665466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.665566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.665791] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.665917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.665997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.666502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.666593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.666692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa is going to be updated. [ 903.700912] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.701280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.701280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.701417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.701599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.712389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 903.712389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.712389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: IN_PROGRESS for 2s [ 903.875312] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.379560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.379560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.379560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.379560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.379560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.379560] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 is going to be created. [ 904.408921] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.409049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.409104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.409342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.409505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.422662] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: UNINITIALIZED for 2s [ 904.831700] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 904.832070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.630883] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 905.632360] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 905.632360] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 905.633657] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 905.633657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.633657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.633657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.633657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.633657] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.633657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.633922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.633922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.633979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.635503] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.638528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.638528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.638528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.638528] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.725354] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa in Status: SUCCESS [ 905.725959] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa deletion is rescheduled due to dependency. [ 905.726924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.744389] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_rules [ 905.744571] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 905.744709] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 905.744839] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 905.744966] env[65738]: INFO networking_nsxv3.common.synchronization [req-d26c3b49-2a1f-4be8-9f2c-b16d476656a4 req-bd31fda4-ebbc-4dc8-89c5-f3bc63257dd2 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 905.745543] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_rules [ 905.745882] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 905.745936] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 905.746021] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 905.746115] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 905.746455] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.746536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.746602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.746912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.746990] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.748290] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.748404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.748471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.748649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.750256] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.754020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7b0ffb-b81f-451b-880f-79bcb617f801 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.754020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.754020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.754020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.754020] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7b0ffb-b81f-451b-880f-79bcb617f801',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.754584] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.754709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.754974] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.755192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.138021] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.141023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.253098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.253267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.256707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7b0ffb-b81f-451b-880f-79bcb617f801 with status ACTIVE [ 906.256966] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.257172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.257274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.257551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.257658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.257909] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.258013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.258090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.258318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.258487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.258661] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.258661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.258889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.258889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.259039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.259039] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 is going to be updated. [ 906.260860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.260860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.284833] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.284833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.284833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.284833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.285060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.285233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.436891] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: SUCCESS [ 906.436891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.437132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.437303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.437550] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.437676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.437806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.438110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.438337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.438406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.438520] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.640672] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.642448] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.941288] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.142952] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.150398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be created. [ 907.150398] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.150398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.150398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 907.181614] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.181614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.181614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.181614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.186793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.186971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.187070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.187411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.187578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.203386] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 907.203386] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: UNINITIALIZED for 2s [ 907.443733] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df92bfb8-0963-460c-8470-de80a6dd7728: rpc.has_security_group_logging(os_id): False [ 907.465421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.465634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.465634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.465860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.465906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.466202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.466366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.466426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.466661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.466733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.466785] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 is going to be created. [ 907.533545] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.534182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.534182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.534182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.534348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.545118] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: IN_PROGRESS for 2s [ 909.218540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 909.218540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.218897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.219118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.219859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.219859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.219859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.219859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.219859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.220095] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.222619] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 909.222619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.222619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.222930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.223195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.223535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.224026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.224026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.224026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.224026] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.520706] env[65738]: INFO networking_nsxv3.common.synchronization [req-38510e0b-f2dd-4564-ae73-ea35be2f368e req-7f53667c-3a92-492a-ab49-1fe96fe899f1 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 909.521737] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 909.522128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.522250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.522323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.522533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.522695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.522796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.522884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.523082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.523172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523292] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.564054] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: SUCCESS [ 909.564286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.722412] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.726147] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.026236] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.224964] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.229765] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.516202] env[65738]: INFO networking_nsxv3.common.synchronization [req-0724eea8-af83-4762-a126-30fced9e4686 req-b05b2c9b-03f3-464a-8fd3-9699e15f6f34 tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 910.520023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 910.520023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.520023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.520023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.520023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.527340] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.728357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.728562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.728637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.728874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.729022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.729147] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be updated. [ 910.731373] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.731562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.731729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.731876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.731958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.732540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 910.764973] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.764973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.764973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.764973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.765766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.769795] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.769964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.770077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.770355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.770561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.784054] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 910.785078] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 911.021725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.023417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.023510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.023743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.023839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.024270] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.024458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.024534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.024705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.024786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.024884] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 911.030819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.030960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.031049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.031308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.031382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.031522] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 911.057265] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.057558] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.057886] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.057984] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.059234] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.059234] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.059533] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.059662] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.059795] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.060248] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.060367] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.060572] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.060641] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.060740] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.061217] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.061287] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.063409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.063539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.063592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.063817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.063909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.070889] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.071029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.071106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.071305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.071451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.085586] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 911.086289] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 911.099781] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.099993] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.100128] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.101061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.101441] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.101663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.101752] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.102117] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.102742] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.606813] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.607139] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.607139] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.607334] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.607575] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.607738] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 not found, creating... [ 911.608017] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.608267] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.608445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.608722] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.608867] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.609181] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.609341] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.609457] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.609675] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.609796] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.609937] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 is going to be created. [ 911.630925] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.633037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.633037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.633037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.633037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.633037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.344020] env[65738]: INFO networking_nsxv3.common.synchronization [req-0724eea8-af83-4762-a126-30fced9e4686 req-59d80fb3-fa7f-412c-b83f-8416b5b82d04 service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 912.344020] env[65738]: INFO networking_nsxv3.common.synchronization [req-0724eea8-af83-4762-a126-30fced9e4686 req-59d80fb3-fa7f-412c-b83f-8416b5b82d04 service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 912.344020] env[65738]: INFO networking_nsxv3.common.synchronization [req-0724eea8-af83-4762-a126-30fced9e4686 req-59d80fb3-fa7f-412c-b83f-8416b5b82d04 service nova] Enqueued Resource ID: ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 with Priority: HIGHEST for action port [ 912.344517] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 912.344650] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 912.344745] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 with Priority: HIGHEST for action port [ 912.345021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.345157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.345198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.345399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.345480] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.346540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.346540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.346648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.346709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.346797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.346942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.347027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.797945] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 912.798750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.799705] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 912.799965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.800124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.800352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.800656] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.800777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.800841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.801032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.801133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.801240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.801332] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.802154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.802312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.802469] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.802591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.802657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.802795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.802891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.803053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.803053] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.848919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.849047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.849230] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 with status ACTIVE [ 912.849396] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.849503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.849561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.853118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.853118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.853118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.853118] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776 is going to be updated. [ 912.875146] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.875328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.875328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.875706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.875852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.876160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccaca4e3-81e2-49a2-a3b7-cdf5e62a2776" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.099730] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 913.100244] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 deletion is rescheduled due to dependency. [ 913.100244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.100828] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 913.101029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.101228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.101447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.101701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.101826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.101898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.102126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.102176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.102257] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.293168] env[65738]: INFO networking_nsxv3.common.synchronization [req-804d8a79-7333-48f0-9784-af6fcd07183d req-c4d4eb34-223e-4b88-b3cf-391310f6431f tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 913.293168] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 913.293168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.293168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.293168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.293168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.293767] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.294085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.294928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.295358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.295615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.295835] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.307336] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.307336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.307336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.307336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.307336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.307336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.308127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.308127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.308127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.310165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.310165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.310165] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.433315] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 913.433315] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 913.435377] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 913.435377] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 913.435377] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 913.435377] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 913.435377] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-59ee5247-ef54-48f0-aba1-a1d21c4bb023 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.435377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.435377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.435377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.435758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.435758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.435758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.435878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.436334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.436334] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.437158] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.437158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.437245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.437463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.437560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.437705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.437739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.438342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.438342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.438342] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.439268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.439360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.439449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.439656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.439719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.440095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.440165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.440312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.440393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.440484] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.494349] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_rules [ 913.494534] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 913.494672] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_rules [ 913.494799] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 913.494922] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 913.495063] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 913.495193] env[65738]: INFO networking_nsxv3.common.synchronization [req-e46e0a62-2dfa-4201-a8dd-b7b64e065161 req-d47b41ab-7c65-4a4d-91cc-3240d81162e8 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 913.495797] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_rules [ 913.496078] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_rules [ 913.496221] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 913.496319] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 with Priority: HIGHEST for action port [ 913.496410] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_rules [ 913.496498] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 913.496588] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 913.497173] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.497292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.497508] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59ee5247-ef54-48f0-aba1-a1d21c4bb023 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.497627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.497706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.498146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.498146] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.498959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.499069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.499254] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7b0ffb-b81f-451b-880f-79bcb617f801 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.499354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.499410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.499649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.499649] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7b0ffb-b81f-451b-880f-79bcb617f801',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.500681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.500782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.500999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.501106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.501298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-59ee5247-ef54-48f0-aba1-a1d21c4bb023 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.501380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.605174] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.717251] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.717620] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.717779] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.718234] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.718768] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.719059] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.719288] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.719647] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.719923] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.720876] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.721068] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.721235] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.721398] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.721564] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.721724] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.721941] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.745789] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.745789] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.745789] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.745789] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-860" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.745973] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-9f489047-60da-479e-a5f7-3eb5fac20af6 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.746215] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.746343] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.746679] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.746829] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f489047-60da-479e-a5f7-3eb5fac20af6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.799284] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.799629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.799629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.799767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.799861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.800085] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.800207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.800271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.800426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.800504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.800591] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 already deleted. [ 913.800673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.810977] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 198f2d52-4200-42b2-be51-13b90ddae50d: rpc.has_security_group_logging(os_id): False [ 913.812321] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 913.831886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.832105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.832208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.832498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.832610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.832901] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.833014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.833075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.833242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.833319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.833500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.833592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.833653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.833789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.833861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.834096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.834198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.834259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.834398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.834471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.834555] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 913.836603] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.836802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.836909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.837125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.837287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.837597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.837754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.837836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.838072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.838235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.838423] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be created. [ 913.916862] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.917078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.917125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.917337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.917610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.926108] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.926302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.926412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.926700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.926897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.935411] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 913.942025] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.948175] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.950582] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.955909] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 914.006292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-59ee5247-ef54-48f0-aba1-a1d21c4bb023 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.006292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.006292] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7b0ffb-b81f-451b-880f-79bcb617f801 with status ACTIVE [ 914.006292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.006660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.006660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.006660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.006875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.006970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.007115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.007249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.007341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.007419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.007704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.007805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.007878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.008011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.008087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.008173] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7b0ffb-b81f-451b-880f-79bcb617f801 is going to be updated. [ 914.040319] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.040515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.040515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.040793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.041138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.041138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7b0ffb-b81f-451b-880f-79bcb617f801" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.106985] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.249636] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.249966] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.250166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.250493] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.250685] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.250881] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 9f489047-60da-479e-a5f7-3eb5fac20af6 not found, creating... [ 914.251218] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.251417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.251571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.251949] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.252265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.252710] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.252887] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.253657] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.253657] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.253657] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.253657] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 9f489047-60da-479e-a5f7-3eb5fac20af6 is going to be created. [ 914.284895] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.284895] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.284895] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.284895] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.285121] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.285274] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.444857] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.452065] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.452740] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.609533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.613113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.613113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.613113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.613113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.613113] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 914.647213] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.647362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.647506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.647741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.647915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.659018] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 914.947699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.948082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.948082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.948248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.948344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.948535] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 is going to be created. [ 914.957327] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.957518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.957574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.957856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.957966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.958075] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be updated. [ 914.959595] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.959714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.959831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.960538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.960710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.960853] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 914.982337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.983746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.983817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.990091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.990091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.990091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.990091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.990091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.991979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.991979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.991979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.992164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.992269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.995517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 in Status: UNINITIALIZED for 2s [ 914.999520] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 915.000756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 915.077648] env[65738]: INFO networking_nsxv3.common.synchronization [req-804d8a79-7333-48f0-9784-af6fcd07183d req-71460195-c627-4a05-bce4-d91d2f6dde11 service nova] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 915.077878] env[65738]: INFO networking_nsxv3.common.synchronization [req-804d8a79-7333-48f0-9784-af6fcd07183d req-71460195-c627-4a05-bce4-d91d2f6dde11 service nova] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 915.077991] env[65738]: INFO networking_nsxv3.common.synchronization [req-804d8a79-7333-48f0-9784-af6fcd07183d req-71460195-c627-4a05-bce4-d91d2f6dde11 service nova] Enqueued Resource ID: 9f489047-60da-479e-a5f7-3eb5fac20af6 with Priority: HIGHEST for action port [ 915.078969] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_rules [ 915.079129] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 915.079641] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f489047-60da-479e-a5f7-3eb5fac20af6 with Priority: HIGHEST for action port [ 915.080124] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.080278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.080379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.080711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.080711] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.081677] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.081794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.081859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.082079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.082240] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.082321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.082381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.082525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.082611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.082700] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.083483] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f489047-60da-479e-a5f7-3eb5fac20af6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.083595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.083661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.083810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.083882] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f489047-60da-479e-a5f7-3eb5fac20af6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.311825] env[65738]: INFO networking_nsxv3.common.synchronization [req-250a4e5b-caf7-4b9e-9cb0-617780f34208 req-f65a157a-eaaf-4aa2-852a-26214a4e4acb tempest-ServersWithSpecificFlavorTestJSON-871227902 tempest-ServersWithSpecificFlavorTestJSON-871227902-project-member] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 915.312135] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGHEST for action security_group_members [ 915.312465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.312592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.312660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.312883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.313061] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.313165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.313228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.313397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.313487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.313580] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.585087] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.588019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.588019] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f489047-60da-479e-a5f7-3eb5fac20af6 with status ACTIVE [ 915.588019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.588019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.588019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.588570] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.588570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.588570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.588570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.588689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.588796] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f489047-60da-479e-a5f7-3eb5fac20af6 is going to be updated. [ 915.609752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.609961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.610040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.610246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.610387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.611017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f489047-60da-479e-a5f7-3eb5fac20af6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.816958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.817241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.817241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.819106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.819106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.819106] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be updated. [ 915.855745] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.856340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.856474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.856805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.857012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.869322] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: IN_PROGRESS for 2s [ 915.951595] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 915.951595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.951595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.951595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.952254] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.973946] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 915.973946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.973946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.974446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.974629] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.067543] env[65738]: INFO networking_nsxv3.common.synchronization [req-bfa94a96-75a0-4cef-9497-6983ce864130 req-2314af03-1a58-4f1c-bf00-36ea90850107 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 916.068251] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 916.068627] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.068759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.068826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.069046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.069212] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.069315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.069418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.069526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.069616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.069710] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.087629] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.437577] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.437577] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.437577] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.437577] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.437577] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.438087] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.438427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.438804] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.439072] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.439390] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.439652] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.439850] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.440051] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.440266] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.440456] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.440689] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.455050] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.455422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.477350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.477350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.487787] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.487787] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.487787] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.487787] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.487787] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.488179] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.488179] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.488428] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.488640] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.571877] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.572152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.572291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.572594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.572747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.573066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.573227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.573334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.573711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.573711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.573812] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 916.590920] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.591071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.591141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.591336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.591419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.591517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 is going to be created. [ 916.602696] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.602846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.602887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.603093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.603232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.610658] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 916.616375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.616375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.616375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.616375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.616375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.626947] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: UNINITIALIZED for 2s [ 916.668877] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 916.669683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.669683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.669683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.669683] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.669979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.669979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.670127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.670127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.670232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.670336] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.990664] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.990969] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.991094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.991367] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.991507] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.991658] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e not found, creating... [ 916.991919] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.992080] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.992194] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.992403] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.992541] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.992858] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.993099] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.993222] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.993478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.993633] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.993817] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e is going to be created. [ 917.007347] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 in Status: SUCCESS [ 917.007425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.007691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.007918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.008134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.008272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.008354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.008534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.008641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.008751] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.017825] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 917.018093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.018229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.018448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.018650] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.019658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.019658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.020420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.020420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.020605] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.022816] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 917.023163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.024252] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.025810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.025810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.025810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.025810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.025973] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.026807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.027245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.027245] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.027245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.027401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.027430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.027616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.028487] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.174394] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.174608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.174722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.175046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.175281] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.175384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.175655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.175915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.176107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.176222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.176404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.176477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.176545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.176785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.176993] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.177112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.177175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.177319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.177394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.177476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.177615] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.266024] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b00ca58-b889-40ca-b26a-f90d73535305 req-43c7f3b6-1e5a-4929-89c1-4086d308c5a3 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 917.266024] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b00ca58-b889-40ca-b26a-f90d73535305 req-43c7f3b6-1e5a-4929-89c1-4086d308c5a3 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 917.266024] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b00ca58-b889-40ca-b26a-f90d73535305 req-43c7f3b6-1e5a-4929-89c1-4086d308c5a3 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 917.266707] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198f2d52-4200-42b2-be51-13b90ddae50d with Priority: HIGHEST for action security_group_members [ 917.266973] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 with Priority: HIGHEST for action security_group_members [ 917.268357] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 917.268357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-198f2d52-4200-42b2-be51-13b90ddae50d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.268357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.268357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-59ee5247-ef54-48f0-aba1-a1d21c4bb023 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.268357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.268357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.268357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.514017] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.530275] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.531318] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.680619] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b62a35a-29b0-4826-a035-6eed21356980: rpc.has_security_group_logging(os_id): False [ 917.701120] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.701273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.701344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.701565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.701655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.701877] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.701976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.702282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.702463] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.702849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.703058] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.703153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.703214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.703353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.703425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.703508] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 917.723570] env[65738]: INFO networking_nsxv3.common.synchronization [req-bfa94a96-75a0-4cef-9497-6983ce864130 req-b14381a1-dc4e-4691-8fcd-d59b157764a1 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 917.723946] env[65738]: INFO networking_nsxv3.common.synchronization [req-bfa94a96-75a0-4cef-9497-6983ce864130 req-b14381a1-dc4e-4691-8fcd-d59b157764a1 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 917.723946] env[65738]: INFO networking_nsxv3.common.synchronization [req-bfa94a96-75a0-4cef-9497-6983ce864130 req-b14381a1-dc4e-4691-8fcd-d59b157764a1 service nova] Enqueued Resource ID: c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e with Priority: HIGHEST for action port [ 917.724437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 917.724545] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 917.724637] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e with Priority: HIGHEST for action port [ 917.724919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.725053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.725123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.725305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.725383] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.726690] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.726786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.726982] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.727100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.727167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.727333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.727399] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.767443] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.767739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.767891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.774042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.774042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.787902] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 917.881056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 in Status: SUCCESS [ 917.881335] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 deletion is rescheduled due to dependency. [ 917.881400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.016604] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.033818] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.034534] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.229015] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.229183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.229365] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e with status ACTIVE [ 918.229539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.229646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.229715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.229936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.230035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.230196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.230290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.230352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.230505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.230584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.230802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.230976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.231102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.231140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.231346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.231389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e is going to be updated. [ 918.281267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.281267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.281267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.281267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.281519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.281519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8ce2df3-b8da-4d9a-9d3c-266c396e8f9e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.519687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.519687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.519930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.519964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.520110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.520192] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 is going to be updated. [ 918.536231] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.536425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.536489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.536782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.536898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.537026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 918.538434] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.538549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.538617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.538809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.538895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.538985] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be updated. [ 918.552931] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.552931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.552931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.552931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.553139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.565049] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 in Status: IN_PROGRESS for 2s [ 918.576609] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.576764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.576865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.577146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.577323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.579478] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.579682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.579682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.580032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.580098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.590504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 918.591161] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 918.633823] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 918.634087] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 918.634232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.634433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.634678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.634890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.635052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.635129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.635295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.635433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.635492] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.637150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: SUCCESS [ 918.637352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.637785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.638954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.638954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.638954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.638954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.638954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.638954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.638954] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.140527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.141574] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.643300] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.644389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d9a650f-180d-4827-8a8a-cdff5aa50644: rpc.has_security_group_logging(os_id): False [ 919.666548] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.666754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.666754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.666985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.667095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.667337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.667438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.667500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.667741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.667789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.667890] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 is going to be created. [ 919.732025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.732025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.732424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.732424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.732549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.757598] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: IN_PROGRESS for 2s [ 919.808934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 919.809247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.146504] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.147524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.147524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.147524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.147524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.147524] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 920.184749] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.184955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.185045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.185280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.185421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.196087] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 920.575479] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 in Status: SUCCESS [ 920.575720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.577107] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.577107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.577107] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.577994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.582019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.582019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.582019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.582019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.582019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.582019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.582019] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.610473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.610473] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.610473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.610473] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.615085] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 920.615337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.619018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619018] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.619018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.620923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.620923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.620923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.620923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.620923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.621274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.621274] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.624183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.624386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.625500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.625500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.625500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.625500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.625500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.625500] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.080686] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59ee5247-ef54-48f0-aba1-a1d21c4bb023',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.082095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.082385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.082534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.082690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.083438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.083438] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.083438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.083438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.083438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.083438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.084193] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 is going to be deleted. [ 921.116587] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.116762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.116808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.117043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.117143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.117239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.125093] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.125377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.125472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.125743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.125858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.126053] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.126171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.126227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.126382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.126454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.126540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be updated. [ 921.128141] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('198f2d52-4200-42b2-be51-13b90ddae50d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.128840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.128932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.129620] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.164564] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.164564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.164564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.164564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.164564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.174427] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 921.586069] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59ee5247-ef54-48f0-aba1-a1d21c4bb023: rpc.has_security_group_logging(os_id): False [ 921.607233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.607390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.607448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.607705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.607843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.608092] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.608199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.608263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.608426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.608503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.608590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 is going to be created. [ 921.630540] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023], does not exist path=[/infra/domains/default/groups/59ee5247-ef54-48f0-aba1-a1d21c4bb023]."\n}' [ 921.630788] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023 [ 921.630929] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 921.632130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 198f2d52-4200-42b2-be51-13b90ddae50d: rpc.has_security_group_logging(os_id): False [ 921.633089] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.651317] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.651743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.651743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.651896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.652058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.652346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.652465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.652541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.652726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.652823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.653531] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d is going to be updated. [ 921.678483] env[65738]: INFO networking_nsxv3.common.synchronization [req-7a21824c-44e2-42d2-96ed-fc0cb031de8c req-c8eb3e46-d198-463a-af82-4cd62212a6c6 tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 921.680390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.680525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.680580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.680788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.682025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.682305] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.682413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.682477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.682644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.682736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.682938] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.683044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.683129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.683282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.683355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.683439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59ee5247-ef54-48f0-aba1-a1d21c4bb023 is going to be created. [ 921.684814] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 921.685166] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.685270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.685339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.685495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.685634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.685726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.685788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.685921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.685995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.686111] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.702366] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023], does not exist path=[/infra/domains/default/groups/59ee5247-ef54-48f0-aba1-a1d21c4bb023]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023 [ 921.702690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59ee5247-ef54-48f0-aba1-a1d21c4bb023" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.703153] env[65738]: Traceback (most recent call last): [ 921.703153] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 921.703153] env[65738]: return func(*args, **kwargs) [ 921.703153] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 921.703153] env[65738]: res.raise_for_status() [ 921.703153] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 921.703153] env[65738]: raise HTTPError(http_error_msg, response=self) [ 921.703153] env[65738]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023 [ 921.703153] env[65738]: During handling of the above exception, another exception occurred: [ 921.703153] env[65738]: Traceback (most recent call last): [ 921.703413] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 921.703413] env[65738]: listener.cb(fileno) [ 921.703413] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 921.703413] env[65738]: result = function(*args, **kwargs) [ 921.703413] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 921.703413] env[65738]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 921.703413] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 921.703413] env[65738]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 921.703413] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 921.703413] env[65738]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 921.703413] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 921.703413] env[65738]: res.raise_for_status() [ 921.703413] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 921.703413] env[65738]: raise HTTPError(http_error_msg, response=self) [ 921.703413] env[65738]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/59ee5247-ef54-48f0-aba1-a1d21c4bb023 [ 921.703413] env[65738]: Removing descriptor: 12 [ 921.718075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.718317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.718317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.718511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.718654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.734309] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: IN_PROGRESS for 2s [ 921.778052] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: SUCCESS [ 921.778052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.898433] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-5eb095ef-690d-432f-979a-57d9828be097 tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 921.899093] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 921.899475] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.899576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.899782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.900114] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.900231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.900303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.900454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.900550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.900673] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.136098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.138517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.138517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.138517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.138517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.138517] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 922.171322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.171322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.171322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.171322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.171322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.182266] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 922.188871] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.207808] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.211024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.211024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.211024] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.280928] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.281147] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.281267] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.281524] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.281772] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.281920] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.282046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.282252] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.282387] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.282597] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.282693] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.282796] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.282917] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.282991] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.283108] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.283854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.330656] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.330842] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.330981] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.331185] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.331527] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-e4faf486-059b-406d-9fe0-7c318ebba293 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.331708] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.331846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.332286] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.332440] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4faf486-059b-406d-9fe0-7c318ebba293',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.403351] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.403545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.403604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.403797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.436724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.436999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.437145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.437212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.437414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.437497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.437585] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 922.469556] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.469721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.469763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.469977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.470141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.479906] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 922.692793] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.711645] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.711854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.711854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.712026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.712198] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.712302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.712364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.712512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.712596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.712681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.712827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.712917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.713035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.713124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.713267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.713413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.713413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.713533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.713607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.713685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.713784] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.835202] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.835585] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.835835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.836313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.836572] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.836776] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port e4faf486-059b-406d-9fe0-7c318ebba293 not found, creating... [ 922.837121] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.837296] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.837427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.837678] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.837872] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.841480] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.841480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.841480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.841480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.841932] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.841932] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: e4faf486-059b-406d-9fe0-7c318ebba293 is going to be created. [ 922.867132] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.867357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.867480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.867823] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.868079] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.868330] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.186866] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 923.187166] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 198f2d52-4200-42b2-be51-13b90ddae50d deletion is rescheduled due to dependency. [ 923.187166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.195062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.195062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.195062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.195329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.195329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.195395] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 923.217280] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1: rpc.has_security_group_logging(os_id): False [ 923.231075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.231222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.231289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.231496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.231634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.239173] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.239313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.239381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.239600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.246986] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274996] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 923.408262] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.408397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.408467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.408680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.408824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.428753] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 923.579757] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-95548d48-1f38-4f1b-8ef8-0b70825d3c7e service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 923.579948] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-95548d48-1f38-4f1b-8ef8-0b70825d3c7e service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 923.580107] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-95548d48-1f38-4f1b-8ef8-0b70825d3c7e service nova] Enqueued Resource ID: e4faf486-059b-406d-9fe0-7c318ebba293 with Priority: HIGHEST for action port [ 923.580642] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 923.580781] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 923.580891] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4faf486-059b-406d-9fe0-7c318ebba293 with Priority: HIGHEST for action port [ 923.581162] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.581280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.581346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.581545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.581624] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.583264] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4faf486-059b-406d-9fe0-7c318ebba293 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583996] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4faf486-059b-406d-9fe0-7c318ebba293',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.747818] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 198f2d52-4200-42b2-be51-13b90ddae50d in Status: SUCCESS [ 923.748111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-198f2d52-4200-42b2-be51-13b90ddae50d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.086337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.086492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.086789] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4faf486-059b-406d-9fe0-7c318ebba293 with status ACTIVE [ 924.087104] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.087294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.087421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.087876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.088055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.088345] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.088510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.088625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.088909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.089056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.089387] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.089557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.089773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.089974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.090109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.090252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4faf486-059b-406d-9fe0-7c318ebba293 is going to be updated. [ 924.115234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.115437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.115535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.115806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.115987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.116177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4faf486-059b-406d-9fe0-7c318ebba293" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.194851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 924.195253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.195546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.195876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.196211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.196713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.196713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.196935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.196935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.197058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.197302] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.197454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.197841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.197923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.198134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.198308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.198710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.198710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.198860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.199652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.199652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.490984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 924.491260] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d deletion is rescheduled due to dependency. [ 924.491468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.492042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.492042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.492218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.492363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.492451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.492632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.492744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.492928] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.510654] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-b994c052-0d28-4162-91cd-b12b21f223cf tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 924.511634] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 924.512895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.513030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.703812] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff: rpc.has_security_group_logging(os_id): False [ 924.723988] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.724170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.724388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.724867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.755840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.756267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.756436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.756552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.756847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.756990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.757285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.757447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.757521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.757767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.757938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.759827] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.759827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.759827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.760514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.760662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.760811] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 924.831233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.831423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.831510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.831811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.832024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.859236] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 924.910026] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.910471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.910471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.910643] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.910953] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.911070] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.911888] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.912729] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.912953] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.913541] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.913541] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.913649] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.913786] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.913890] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.913959] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.914200] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.946343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.946544] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.946680] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.946857] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-504" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.947203] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-15d84a21-c0b4-4528-a293-864c50addbb7 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.947366] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.947481] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.947929] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.948029] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15d84a21-c0b4-4528-a293-864c50addbb7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.995482] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.258338] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 925.258619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.444946] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 925.445260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.451130] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.451288] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.451754] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.451754] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.451969] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.452962] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 15d84a21-c0b4-4528-a293-864c50addbb7 not found, creating... [ 925.452962] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.452962] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.452962] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.453181] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.453316] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.453690] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.453896] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.454243] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.454696] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.454891] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.454978] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 15d84a21-c0b4-4528-a293-864c50addbb7 is going to be created. [ 925.482904] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.483324] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.483531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.483829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.484101] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.484403] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.499878] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.003320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.003560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.003687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.003941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.004364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.004364] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 926.040681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.044194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.044293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.044534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.044723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.060100] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 926.242554] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-7098dad2-5c28-4fcf-9a9b-394452aff671 service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 926.243863] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-7098dad2-5c28-4fcf-9a9b-394452aff671 service nova] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 926.243863] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dbb245f-dcee-4216-af3f-9ed51f898ba7 req-7098dad2-5c28-4fcf-9a9b-394452aff671 service nova] Enqueued Resource ID: 15d84a21-c0b4-4528-a293-864c50addbb7 with Priority: HIGHEST for action port [ 926.244367] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_rules [ 926.244507] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 926.244602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d84a21-c0b4-4528-a293-864c50addbb7 with Priority: HIGHEST for action port [ 926.244896] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.245073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.245298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.245386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.245569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-15d84a21-c0b4-4528-a293-864c50addbb7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.245676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.245780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.245914] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.246035] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15d84a21-c0b4-4528-a293-864c50addbb7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.748335] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15d84a21-c0b4-4528-a293-864c50addbb7 with status ACTIVE [ 926.748658] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.748799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.748871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.749180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.749332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.749527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.749635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.749701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.749872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.749955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.750171] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.750290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.750486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.750683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.750761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.750856] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15d84a21-c0b4-4528-a293-864c50addbb7 is going to be updated. [ 926.773903] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.774104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.774147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.774398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.774570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.774762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15d84a21-c0b4-4528-a293-864c50addbb7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.893184] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 926.893437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.072066] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 928.072286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.072488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.072713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.072906] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.073033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.073095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.073265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.073347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.073432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.073528] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.074452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.074631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.074787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.074890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.074962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.075163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.075246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.075333] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.577775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.577775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.579107] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.081946] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.583929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.584079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.584170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.584395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.584492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.584832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 929.615535] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.615698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.615751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.615996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.616158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.626544] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 929.768920] env[65738]: INFO networking_nsxv3.common.synchronization [req-1aa3b679-fcec-4f7f-8fc0-2675c405521c req-1cb497d7-1857-40d1-a3c9-bde7b3896855 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 929.770193] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 929.770675] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.770785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.770850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.771070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.771638] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.771762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.771823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.771998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.772097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.772195] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.274860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.275326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.275326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.275326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.299217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.299538] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.299637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.299719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.299899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.299982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.300084] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 930.332518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.332663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.332748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.332936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.333102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.358928] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 931.639064] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 931.639408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.639472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.639691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.639916] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.640062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.640188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.640782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.640782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.640782] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.976898] env[65738]: INFO networking_nsxv3.common.synchronization [req-2415fffa-7bb8-4286-93ed-b1c5ad615efa req-0ecd2549-fd9c-45ce-87a7-ce6bc7e06b67 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 931.976898] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 931.977300] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.977433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.977433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.978473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.978473] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.978473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.978473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.978473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.978473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.978748] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.142952] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.369058] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 932.369276] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 932.369436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.401844] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.401844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.401844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.401844] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.402119] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.402177] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.402336] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.402566] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.402703] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.402906] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.403025] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.403131] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.403232] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.403401] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.403439] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.404122] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.424203] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.424405] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.424542] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.424678] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.425011] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.425230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.425307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.425643] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.425781] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f833ed-5972-4042-aa3c-7bb5e6ce2d0a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.480918] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.648429] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.929030] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.929030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.929030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.929030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.929030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.929030] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a not found, creating... [ 932.929346] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.929396] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.929538] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.929766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.930342] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.930864] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.931087] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.931199] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.931420] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.932302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.932302] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a is going to be created. [ 932.958107] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.958107] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.958107] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.958401] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.958745] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.958983] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.982808] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.153589] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.153749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.153820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.154054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.154152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.154254] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 933.196286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.196541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.196668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.197024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.197741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.213061] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 933.486357] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.486596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.486596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.487061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.487061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.487061] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 933.522582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.522795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.522868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.524493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.524493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.538316] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 933.733092] env[65738]: INFO networking_nsxv3.common.synchronization [req-2415fffa-7bb8-4286-93ed-b1c5ad615efa req-6f0dd011-59a0-4538-adb4-fed93fafb6b9 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 933.733092] env[65738]: INFO networking_nsxv3.common.synchronization [req-2415fffa-7bb8-4286-93ed-b1c5ad615efa req-6f0dd011-59a0-4538-adb4-fed93fafb6b9 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 933.733092] env[65738]: INFO networking_nsxv3.common.synchronization [req-2415fffa-7bb8-4286-93ed-b1c5ad615efa req-6f0dd011-59a0-4538-adb4-fed93fafb6b9 service nova] Enqueued Resource ID: 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a with Priority: HIGHEST for action port [ 933.733679] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 933.733822] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 933.733918] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a with Priority: HIGHEST for action port [ 933.734259] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.734388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.734454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.734663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.734747] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.736485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.736485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.736485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.736485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.736485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.736485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.737037] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f833ed-5972-4042-aa3c-7bb5e6ce2d0a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.240103] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.240278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.240615] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a with status ACTIVE [ 934.240810] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.242376] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.242376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.242376] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.242967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.242967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.242967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.242967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.242967] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f833ed-5972-4042-aa3c-7bb5e6ce2d0a is going to be updated. [ 934.274334] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.274562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.274634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.274852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.274988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.275173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f833ed-5972-4042-aa3c-7bb5e6ce2d0a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.835546] env[65738]: INFO networking_nsxv3.common.synchronization [req-10f45136-8fa4-4861-a5ed-b721021a55a0 req-dba1b75f-beeb-4faf-9fa3-5c9cbecbc63b tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 934.835546] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 934.836706] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.837347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.837347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.837347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.838888] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.838888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.838888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.838888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.838888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.838888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.226321] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 935.227349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.227349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.227349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.227589] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.227797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.227851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.228058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.228246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.228526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.228737] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.228863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.228944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.229144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.229334] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.229455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.229535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.229703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.229903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.230039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.230521] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.343154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.343609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.343659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.343867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.373969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.374322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.374507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.374622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.375352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.375352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.375352] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 935.405765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.405917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.405984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.406234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.407049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.416376] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 935.551722] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.551722] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.551722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.551722] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.732881] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b13c9f1-4035-4155-8f11-de49c18c0a4d: rpc.has_security_group_logging(os_id): False [ 935.758989] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.758989] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.758989] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.758989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.759604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.759604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.759604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.759604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.759604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.759604] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 935.827655] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.827889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.827889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.828886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.828886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.847940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 936.054802] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.105670] env[65738]: INFO networking_nsxv3.common.synchronization [req-caedf0ad-d2b7-4595-9b9b-e2b5f58fd38e req-7f5aa663-9374-4daa-b687-0625f5f19ad7 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 936.107174] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 936.109761] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.109761] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.109761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.109761] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.397136] env[65738]: INFO networking_nsxv3.common.synchronization [None req-66453845-1529-4c99-8b8e-7e18f462697e None None] Enqueued Resource ID: 74dc3dc4-f2ef-40dc-8432-f9efd951ee38 with Priority: HIGHEST for action port [ 936.397136] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74dc3dc4-f2ef-40dc-8432-f9efd951ee38 with Priority: HIGHEST for action port [ 936.397136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-74dc3dc4-f2ef-40dc-8432-f9efd951ee38 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.397136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74dc3dc4-f2ef-40dc-8432-f9efd951ee38" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.397136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74dc3dc4-f2ef-40dc-8432-f9efd951ee38" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.397856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74dc3dc4-f2ef-40dc-8432-f9efd951ee38" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.398049] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74dc3dc4-f2ef-40dc-8432-f9efd951ee38',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.540264] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.540506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.541240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.541240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.541240] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.541514] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.541514] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.541638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.541780] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.541999] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.542118] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.542229] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.542337] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.542451] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.542555] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.542689] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.557341] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.571323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.571665] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 936.571665] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.571808] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.572119] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-6f388909-ae62-4db0-b03f-2c482421e4d3 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.572300] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.572422] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.572851] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.572904] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f388909-ae62-4db0-b03f-2c482421e4d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.612173] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.900677] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74dc3dc4-f2ef-40dc-8432-f9efd951ee38 [ 936.901091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.901176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.901238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.902490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.902490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.902490] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74dc3dc4-f2ef-40dc-8432-f9efd951ee38 already deleted. [ 936.902490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74dc3dc4-f2ef-40dc-8432-f9efd951ee38" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.060834] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.061071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.061158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.061307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.061399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.061497] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 937.075352] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.075652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.075820] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.076116] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.076309] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.076467] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 6f388909-ae62-4db0-b03f-2c482421e4d3 not found, creating... [ 937.077077] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.077077] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.077077] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.077339] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.077534] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.077846] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.078011] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.078135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.078527] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.078679] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.078831] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 6f388909-ae62-4db0-b03f-2c482421e4d3 is going to be created. [ 937.102265] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.102432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.102480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.102691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.102836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.104806] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.105046] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.105186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.105427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.105667] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.105875] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.113519] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.116715] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 937.430674] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 937.431011] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 deletion is rescheduled due to dependency. [ 937.432532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.616064] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.616314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.616419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.616683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.616800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.617476] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 937.650380] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.650380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.650514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.650664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.650802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.663784] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 937.863265] env[65738]: INFO networking_nsxv3.common.synchronization [req-caedf0ad-d2b7-4595-9b9b-e2b5f58fd38e req-3d367344-e81e-4e65-bd2b-01a9963ff820 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 937.863456] env[65738]: INFO networking_nsxv3.common.synchronization [req-caedf0ad-d2b7-4595-9b9b-e2b5f58fd38e req-3d367344-e81e-4e65-bd2b-01a9963ff820 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 937.863592] env[65738]: INFO networking_nsxv3.common.synchronization [req-caedf0ad-d2b7-4595-9b9b-e2b5f58fd38e req-3d367344-e81e-4e65-bd2b-01a9963ff820 service nova] Enqueued Resource ID: 6f388909-ae62-4db0-b03f-2c482421e4d3 with Priority: HIGHEST for action port [ 937.864498] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 937.864498] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 937.864498] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f388909-ae62-4db0-b03f-2c482421e4d3 with Priority: HIGHEST for action port [ 937.864699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.864816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.864874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.865091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.865170] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.866058] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.866178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.866382] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f388909-ae62-4db0-b03f-2c482421e4d3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.866481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.866546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.866717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.866794] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f388909-ae62-4db0-b03f-2c482421e4d3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.871123] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 937.871364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.871833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.873125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.873260] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.243514] env[65738]: INFO networking_nsxv3.common.synchronization [req-8e0fe220-7772-4662-9a14-d92d1a66c3f1 req-6af4ae9b-0072-40cc-a525-1585bf572c44 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 938.245212] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 938.246031] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.246031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.246031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.246415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.246671] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.247275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.247275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.247275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.247399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.247533] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.369310] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.369310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.379056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f388909-ae62-4db0-b03f-2c482421e4d3 with status ACTIVE [ 938.379056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.379056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.379056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.379056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.379056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f388909-ae62-4db0-b03f-2c482421e4d3 is going to be updated. [ 938.381854] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.382028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.382069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.382467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.382681] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.383325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.383325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.383325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.383325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.383325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.383325] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.410670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.410791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.410791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.411050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.411150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.411316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f388909-ae62-4db0-b03f-2c482421e4d3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.753275] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.886226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.886399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.886399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.886679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.886974] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.886974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.887299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.887299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.887299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.887524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.887524] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.887628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.887706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.887855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.887997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.888103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.888163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.888430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.888513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.888603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.889071] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.128933] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 939.129995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.129995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.129995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.129995] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.129995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.129995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.130267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.130267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.130327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.130421] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.258049] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.395888] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b13c9f1-4035-4155-8f11-de49c18c0a4d: rpc.has_security_group_logging(os_id): False [ 939.418575] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.418721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.418791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.419107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.419225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.419512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.419622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.419688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.419862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.419940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.420203] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.420327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.420391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.420776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.420861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.421076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.421174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.421238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.421420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.421702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.421838] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 939.490236] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.490236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.490236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.490236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.490236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.510111] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 939.634083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.634282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.634338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.634532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.634704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.635767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.635873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.636120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.636304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.636410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.636576] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.636676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.636758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.636920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.637103] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.637204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.637266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.637409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.637506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.637598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.637716] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.674807] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 939.675058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.675247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.675484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.675688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.675813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.675882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.676058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.676401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.676401] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.760071] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.760232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.760301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.760516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.760647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.760787] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 939.793532] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.793532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.793532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.793779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.794009] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.808106] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 940.142600] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 940.162140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.162379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.162379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.162867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.178960] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.187138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.187470] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.187630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.187708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.187977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.188108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.188449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.188583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.188677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.188874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.188988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.189299] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.189448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.189505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.190995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.190995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.190995] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 940.284047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.284497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.284497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.284497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.284634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.324708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 940.682950] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.932547] env[65738]: INFO networking_nsxv3.common.synchronization [None req-74eaa13a-3104-476a-b19b-04033f1f2a72 None None] Enqueued Resource ID: c89589d0-3dc1-4664-bdcd-8b21efadbf33 with Priority: HIGHEST for action port [ 940.933719] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c89589d0-3dc1-4664-bdcd-8b21efadbf33 with Priority: HIGHEST for action port [ 940.935156] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c89589d0-3dc1-4664-bdcd-8b21efadbf33 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.935156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c89589d0-3dc1-4664-bdcd-8b21efadbf33" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.935156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c89589d0-3dc1-4664-bdcd-8b21efadbf33" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.935156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c89589d0-3dc1-4664-bdcd-8b21efadbf33" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.935156] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c89589d0-3dc1-4664-bdcd-8b21efadbf33',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.186271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.186516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.186598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.186863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.186966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.187187] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 941.222680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.223049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.223049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.223125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.223239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.234473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 941.437960] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c89589d0-3dc1-4664-bdcd-8b21efadbf33 [ 941.437960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.437960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.437960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.438490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.438490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.438490] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c89589d0-3dc1-4664-bdcd-8b21efadbf33 already deleted. [ 941.438490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c89589d0-3dc1-4664-bdcd-8b21efadbf33" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.541650] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 941.541796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.820435] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 941.820902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.861724] env[65738]: INFO networking_nsxv3.common.synchronization [req-2f5f918d-2d6a-407f-bf36-2ed23760b48b req-f3d4a937-fb3b-41b7-9ece-1880e8e531df tempest-ListServerFiltersTestJSON-1147169524 tempest-ListServerFiltersTestJSON-1147169524-project-member] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 941.862347] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGHEST for action security_group_members [ 941.863591] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.863591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.863591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.863591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.865362] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.865535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.865535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.866956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.866956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.866956] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.073356] env[65738]: INFO networking_nsxv3.common.synchronization [req-6dca4476-7466-4c87-a541-640c1eb8aaf9 req-86ac1319-c98b-427e-9bb7-568bd71d4765 tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 942.073976] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 942.074493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.074640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.074856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.074996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.075219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.075345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.075409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.075621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.075754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.075904] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.349098] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 942.351271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.368568] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.368762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.368835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.369117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.396356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.396632] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.396758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.396825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.397058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.397147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.397239] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be updated. [ 942.433801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.434146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.434622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.435030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.435331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.449914] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: IN_PROGRESS for 2s [ 942.581896] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.721559] env[65738]: INFO networking_nsxv3.common.synchronization [req-afb7d38f-2a96-4a63-bbdf-8f8b972c033e req-ac8c1765-f0f0-439a-a52b-c9b2310f549c tempest-MultipleCreateTestJSON-1164871571 tempest-MultipleCreateTestJSON-1164871571-project-member] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 942.722323] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGHEST for action security_group_members [ 942.722740] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.722848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.084835] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.248223] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 4s [ 943.588563] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.588563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.588563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.588563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.588563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.588563] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 943.619930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.620162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.620231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.620454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.620600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.631645] env[65738]: INFO networking_nsxv3.common.synchronization [req-e104ce0e-fed4-41fd-b1ed-3df06ef1dcd6 req-d792d37d-3ed3-44cc-94ee-54bae85e8b7a tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 943.632534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 943.633018] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 943.633417] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.633573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.633642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.633900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.634128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.634274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.634351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.634537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.634627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.634725] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.092196] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.092416] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.092543] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.092819] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.093098] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.093256] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.093383] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.093671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.093743] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.093960] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.094163] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.094205] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.094296] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.094398] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.094506] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.094642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.114599] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.114791] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.114930] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.115126] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.115492] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-02c80283-3607-4fee-beb4-aba6f4485131 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.115690] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.115812] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.116212] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.116798] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c80283-3607-4fee-beb4-aba6f4485131',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.136974] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.137187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.137226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.137433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.137545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.137777] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.138240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.138240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.138240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.138240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.138510] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 944.173023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.173246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.173246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.173514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.173750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.186382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 944.462214] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e49fe7b-0238-41d4-921e-d91254c2761b in Status: SUCCESS [ 944.462214] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b deletion is rescheduled due to dependency. [ 944.462214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.618786] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.619141] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.619141] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.619392] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.619530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.619670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 02c80283-3607-4fee-beb4-aba6f4485131 not found, creating... [ 944.619929] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.620097] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.620211] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.620424] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.620553] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.620861] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.621026] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.621147] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.621384] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.621517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.621657] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 02c80283-3607-4fee-beb4-aba6f4485131 is going to be created. [ 944.641997] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642221] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.642367] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.642603] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.642845] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.643075] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.826385] env[65738]: INFO networking_nsxv3.common.synchronization [req-858c62ba-23b6-4cb3-a91a-025c6820e597 req-c4f569db-3733-4679-9809-bf8252fdc272 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 944.826616] env[65738]: INFO networking_nsxv3.common.synchronization [req-858c62ba-23b6-4cb3-a91a-025c6820e597 req-c4f569db-3733-4679-9809-bf8252fdc272 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 944.826762] env[65738]: INFO networking_nsxv3.common.synchronization [req-858c62ba-23b6-4cb3-a91a-025c6820e597 req-c4f569db-3733-4679-9809-bf8252fdc272 tempest-SecurityGroupsTestJSON-395451659 tempest-SecurityGroupsTestJSON-395451659-project-member] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 944.827555] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGHEST for action security_group_members [ 944.827760] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff with Priority: HIGHEST for action security_group_members [ 944.827929] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGHEST for action security_group_members [ 944.828288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.828462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.828528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.828812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.829025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.829169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.829246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.829474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.829622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.829768] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.830951] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.831162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.831579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.831663] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.832051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.832051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.832180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.832415] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60fa81d8-8f48-4912-b0e6-1cff6e6ccdff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.833490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.833490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.833594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.833733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.833930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.834141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.834195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.834362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.834490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.834628] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.220794] env[65738]: INFO networking_nsxv3.common.synchronization [req-f306b0f9-d20c-4fe5-bbda-656db2f7d560 req-e837e725-45e3-4c87-9136-034dadb7023b tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 945.221259] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGHEST for action security_group_members [ 945.221683] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.221683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.221875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.222055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.222172] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.222267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.222310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.222459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.222542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.222700] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.262909] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.262909] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.262909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.263473] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.337070] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.337857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.337857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.337857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.338044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.338180] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.338283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.338351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.338558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.338633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.338723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff is going to be updated. [ 945.339907] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.340040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.340098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.340250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.341318] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.341425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.367421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.367421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.367584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.367671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.367943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.368089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.368206] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff is going to be updated. [ 945.369988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.370239] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.377950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.378188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.378295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.378562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.378762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.388106] env[65738]: INFO networking_nsxv3.common.synchronization [req-e104ce0e-fed4-41fd-b1ed-3df06ef1dcd6 req-68de91cb-4cdb-4458-9401-8ab0a0aba09b service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 945.389078] env[65738]: INFO networking_nsxv3.common.synchronization [req-e104ce0e-fed4-41fd-b1ed-3df06ef1dcd6 req-68de91cb-4cdb-4458-9401-8ab0a0aba09b service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 945.389078] env[65738]: INFO networking_nsxv3.common.synchronization [req-e104ce0e-fed4-41fd-b1ed-3df06ef1dcd6 req-68de91cb-4cdb-4458-9401-8ab0a0aba09b service nova] Enqueued Resource ID: 02c80283-3607-4fee-beb4-aba6f4485131 with Priority: HIGHEST for action port [ 945.389305] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 945.389460] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 945.389642] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c80283-3607-4fee-beb4-aba6f4485131 with Priority: HIGHEST for action port [ 945.390713] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: IN_PROGRESS for 2s [ 945.391105] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.391327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.391674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.391715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.391874] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.393346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.393454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.393766] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-02c80283-3607-4fee-beb4-aba6f4485131 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.394799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.394911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.395215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.395347] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02c80283-3607-4fee-beb4-aba6f4485131',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.399871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.400395] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.400395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.400395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.400576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.400886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be updated. [ 945.415433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.415934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.415934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.416933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.416933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.430202] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: IN_PROGRESS for 2s [ 945.435502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.435634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.435796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.435970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.436157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.447930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: IN_PROGRESS for 2s [ 945.645444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.645444] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.645444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.645999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.645999] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.726055] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.726259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.726329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.726588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.754324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.754588] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.754714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.754791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.755014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.755100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.755193] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee is going to be updated. [ 945.766941] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.767156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.767156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.767490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.767741] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.767885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.768024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.768315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.768484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.768643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.768860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.768993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.769077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.769262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.769424] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.769551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.769639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.769795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.769882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.770036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.770157] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.787527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.787799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.787799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.787997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.788105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.970497] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: IN_PROGRESS for 2s [ 945.970697] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.970810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.970984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02c80283-3607-4fee-beb4-aba6f4485131 with status ACTIVE [ 945.971218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.971355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.971442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.971719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.971835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.972075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.973508] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.973508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.973508] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02c80283-3607-4fee-beb4-aba6f4485131 is going to be updated. [ 946.001425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.001597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.001687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.001856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.001994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.002167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02c80283-3607-4fee-beb4-aba6f4485131" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.149710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.149915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.149954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.150349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.150439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.150680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.150846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.150897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.151186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.151298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.151391] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be updated. [ 946.200130] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.200130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.200130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.200130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.200130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.200130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 946.201251] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 946.201251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.201251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.201251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.201371] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.201427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.201458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.201710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.201710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.201789] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.209307] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 2s [ 946.273502] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 946.318868] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.318868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.318868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.319265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.319265] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.319405] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.319506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.319766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.319944] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.320212] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.320457] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.320457] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.320614] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.320663] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.320756] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.320890] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.322938] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.322938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.322938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.323198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.370934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.371271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.371464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.371464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.371674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.371758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.371969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.372082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.372164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.372348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.372489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.372649] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.372742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.372801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.372947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.373064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.373120] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 946.377343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.377574] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.377743] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.377952] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-494" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.378406] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.378676] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.378762] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.379036] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.379175] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919e0b81-8c2d-42c4-ac9f-8ba0c7529489',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.474708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.474869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.474954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.475205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.475328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.493631] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 946.705523] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.882460] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.882712] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.882870] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.883134] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.883292] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.883588] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.883829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.883947] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.884201] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.884337] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.884630] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.884874] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.884989] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.885211] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.885345] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.885496] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 is going to be updated. [ 946.910557] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.910826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.910973] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.911400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.911575] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.911800] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.211020] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.402605] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff in Status: SUCCESS [ 947.402929] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60fa81d8-8f48-4912-b0e6-1cff6e6ccdff deletion is rescheduled due to dependency. [ 947.402929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60fa81d8-8f48-4912-b0e6-1cff6e6ccdff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.439196] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff in Status: SUCCESS [ 947.439196] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff deletion is rescheduled due to dependency. [ 947.439196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.460935] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 in Status: SUCCESS [ 947.460935] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 deletion is rescheduled due to dependency. [ 947.460935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.603687] env[65738]: INFO networking_nsxv3.common.synchronization [req-eda0cf45-b3eb-4e3b-a843-d4d647f9c236 req-d069e6e9-cc32-4441-9f4c-f5c275831aaf service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 947.604417] env[65738]: INFO networking_nsxv3.common.synchronization [req-eda0cf45-b3eb-4e3b-a843-d4d647f9c236 req-d069e6e9-cc32-4441-9f4c-f5c275831aaf service nova] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 947.604417] env[65738]: INFO networking_nsxv3.common.synchronization [req-eda0cf45-b3eb-4e3b-a843-d4d647f9c236 req-d069e6e9-cc32-4441-9f4c-f5c275831aaf service nova] Enqueued Resource ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with Priority: HIGHEST for action port [ 947.605438] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_rules [ 947.605438] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 947.605438] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with Priority: HIGHEST for action port [ 947.605438] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.605607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.605607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.607151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.607151] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.607330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.607395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.607434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.607630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.607772] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.607860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.607916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.608066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.608169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.608229] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.610330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.614107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.614107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.614107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.614228] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919e0b81-8c2d-42c4-ac9f-8ba0c7529489',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.714921] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.715304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.715304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.715423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.715477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.715582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 947.749119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.749289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.749361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.749584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.749734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.761453] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 947.982984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee in Status: SUCCESS [ 947.983263] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee deletion is rescheduled due to dependency. [ 947.983401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.116875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.116875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.116875] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.117596] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 with status ACTIVE [ 948.117706] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.117803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.117893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.118153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.118291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.118485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.118658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.118718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.118893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.118981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119208] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.119324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.119392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.119604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.119692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119778] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 919e0b81-8c2d-42c4-ac9f-8ba0c7529489 is going to be updated. [ 948.143209] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.143358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.143417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.143700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.143840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.143933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919e0b81-8c2d-42c4-ac9f-8ba0c7529489" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.219553] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: IN_PROGRESS for 4s [ 948.510036] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 948.510585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.621874] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.985093] env[65738]: INFO networking_nsxv3.common.synchronization [None req-778a2cb9-3893-4d65-b825-7e2a19e07407 None None] Enqueued Resource ID: cd3ea56f-36b2-4318-a99c-a6f95c81464e with Priority: HIGHEST for action port [ 948.985093] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd3ea56f-36b2-4318-a99c-a6f95c81464e with Priority: HIGHEST for action port [ 948.985093] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd3ea56f-36b2-4318-a99c-a6f95c81464e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.985093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd3ea56f-36b2-4318-a99c-a6f95c81464e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.985093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd3ea56f-36b2-4318-a99c-a6f95c81464e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.985582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd3ea56f-36b2-4318-a99c-a6f95c81464e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.985582] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd3ea56f-36b2-4318-a99c-a6f95c81464e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.123929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.124203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.124203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.124468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.124584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.124690] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 949.163291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.163549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.163549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.163768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.163906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.178833] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 949.488582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd3ea56f-36b2-4318-a99c-a6f95c81464e [ 949.488677] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.488818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.488904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.490343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.490343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.490343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd3ea56f-36b2-4318-a99c-a6f95c81464e already deleted. [ 949.490343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd3ea56f-36b2-4318-a99c-a6f95c81464e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.772748] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 949.773163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.773249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.773415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.773600] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.773716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.773811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.774064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.774064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.774185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.774217] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.993371] env[65738]: INFO networking_nsxv3.common.synchronization [None req-14214af0-dad0-4df2-82c1-b4818cd66464 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 949.994949] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 949.994949] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.994949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.994949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.994949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.994949] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.113186] env[65738]: INFO networking_nsxv3.common.synchronization [None req-733131c9-0576-4420-827d-db5f5b54fa1a tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 950.113771] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 950.114067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.115069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.230944] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d in Status: SUCCESS [ 950.230944] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d deletion is rescheduled due to dependency. [ 950.230944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.279650] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.279889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.279947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.280244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.280453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.280561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.280627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.280808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.280894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.281040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.281147] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.281238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.281397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.281467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.281566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.281654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.281713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.281846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.281919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.281997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.282188] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.521370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.521370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d9f780-2387-4768-9bde-778929c0c06d already deleted. [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.521370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.521370] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.785267] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 950.805725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.806073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.806280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.806952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.807088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.807320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.807433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.807494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.807666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.807742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.807945] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.808168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.808258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.808374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.808454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.808743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.808922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.809020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.809182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.809258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.809468] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 950.875077] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.875231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.875300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.875514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.875655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.894369] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 951.052621] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.052621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.053245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.053245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.053245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.053245] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d9f780-2387-4768-9bde-778929c0c06d already deleted. [ 951.053545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.195071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 951.195289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.195495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.195783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.196056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.196225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.196305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.196482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.196596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.196702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.196796] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.675837] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b4694954-e959-4ce0-a9fe-9af8ba5f2df1 None None] Enqueued Resource ID: d69451d4-36a9-4313-a31e-9cc23de020ab with Priority: HIGHEST for action port [ 951.676437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d69451d4-36a9-4313-a31e-9cc23de020ab with Priority: HIGHEST for action port [ 951.676826] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d69451d4-36a9-4313-a31e-9cc23de020ab taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.677013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d69451d4-36a9-4313-a31e-9cc23de020ab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.677083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d69451d4-36a9-4313-a31e-9cc23de020ab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.677286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d69451d4-36a9-4313-a31e-9cc23de020ab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.677360] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d69451d4-36a9-4313-a31e-9cc23de020ab',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.700175] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.700175] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.700175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.700662] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.700662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.700662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.700792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.700832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.701397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.701397] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.180096] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d69451d4-36a9-4313-a31e-9cc23de020ab [ 952.180437] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.180500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.180535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.180751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.180839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.180934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d69451d4-36a9-4313-a31e-9cc23de020ab already deleted. [ 952.181026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d69451d4-36a9-4313-a31e-9cc23de020ab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.207080] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89618efc-1c71-4f3b-9cfc-d651fcf1fe99: rpc.has_security_group_logging(os_id): False [ 952.252416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.252620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.252620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.254714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.277738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.278069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.278266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.278266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.278512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.278601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.278867] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.278975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.279068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.279222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.279301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.279543] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.279645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.279760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.279862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.279940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.281339] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 952.366062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.366062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.366247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.366352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.367057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.383037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 952.628037] env[65738]: INFO networking_nsxv3.common.synchronization [req-542e2599-7ae2-4766-975e-6e6f53400349 req-b7494594-42b8-4af3-a840-d722492b2477 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 952.628773] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 952.629205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.629359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.629452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.629628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.629820] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.629955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.630087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.630422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.630422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.630527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.915639] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 952.916049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.132871] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.588379] env[65738]: INFO networking_nsxv3.common.synchronization [req-81774344-ce79-4dd2-9c59-961fc40fb897 req-d4e61a2e-3e66-4054-8294-77f1a98bc29f tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 953.588972] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 953.589364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.589494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.589569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.589832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.591312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.591312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.591312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.591585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.591585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.591678] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.635746] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.740127] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd56491b-31d6-4342-8a03-d4372c139c62 req-c5cd0ebf-8a52-45f4-9b33-7b7c96aeca42 tempest-FloatingIPsAssociationTestJSON-1664428748 tempest-FloatingIPsAssociationTestJSON-1664428748-project-member] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 953.740599] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 953.740799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.740915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.740915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.741624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.741624] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.741624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.741624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.741871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.741871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.741871] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.332867] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.332867] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.332867] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 954.332867] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.332867] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 954.332867] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.335396] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.335396] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 already deleted. [ 954.335396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.404343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 954.404343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.456622] env[65738]: INFO networking_nsxv3.common.synchronization [req-2915c1b5-62f4-40e7-a70b-59037ecc323a req-5335c54b-761b-488d-84e5-8d67746fec32 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 954.457661] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 954.458207] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.463205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.463205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.463205] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.611791] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.680713] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-213 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.681110] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.681350] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.681773] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.683472] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.683472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.683472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.683743] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.683921] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.684309] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.684454] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.684574] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.684712] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.684831] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.684965] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.685150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.706056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.706257] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.706399] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.706661] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.707102] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-0bf79cc3-3785-41f0-abc5-639f25449053 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.707313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.707437] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.707898] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.707989] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf79cc3-3785-41f0-abc5-639f25449053',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.966461] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.119078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.119078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.119078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.119078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.119078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.119078] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 955.150922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.151144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.151281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.151551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.151719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.163206] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 955.211338] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.211843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.211843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.212110] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.212304] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.212485] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 0bf79cc3-3785-41f0-abc5-639f25449053 not found, creating... [ 955.215297] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.215707] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.215923] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.216205] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.216356] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.216698] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.216962] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.217136] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.217369] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.218385] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.218575] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 0bf79cc3-3785-41f0-abc5-639f25449053 is going to be created. [ 955.244436] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.244697] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.244818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.245163] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.245400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.245639] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.474130] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.979259] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.979259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.979259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.979259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.979259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.979259] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 956.008680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.009483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.009663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.009988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.010251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.020328] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 956.031560] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd56491b-31d6-4342-8a03-d4372c139c62 req-91aa014c-8739-424f-85ef-0cffd1a07ab8 service nova] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_rules [ 956.031820] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd56491b-31d6-4342-8a03-d4372c139c62 req-91aa014c-8739-424f-85ef-0cffd1a07ab8 service nova] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 956.031967] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd56491b-31d6-4342-8a03-d4372c139c62 req-91aa014c-8739-424f-85ef-0cffd1a07ab8 service nova] Enqueued Resource ID: 0bf79cc3-3785-41f0-abc5-639f25449053 with Priority: HIGHEST for action port [ 956.032547] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_rules [ 956.032683] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 956.032841] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bf79cc3-3785-41f0-abc5-639f25449053 with Priority: HIGHEST for action port [ 956.033404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.033530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.033596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.033856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.033970] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.035586] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.035586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.035667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.035833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.035981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.036330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.036432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.036568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.039597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.039597] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.039597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bf79cc3-3785-41f0-abc5-639f25449053 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.039597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.039597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.039597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.039597] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf79cc3-3785-41f0-abc5-639f25449053',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.200187] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 956.200455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.536458] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.536668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.539371] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.544193] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bf79cc3-3785-41f0-abc5-639f25449053 with status ACTIVE [ 956.544193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.544193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.544193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.544193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.545109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.545109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.545109] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bf79cc3-3785-41f0-abc5-639f25449053 is going to be updated. [ 956.580134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.580134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.580134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.580430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.580467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.580625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bf79cc3-3785-41f0-abc5-639f25449053" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.041574] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.174660] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 957.174881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.544393] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.544607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.544682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.544909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.544990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.545138] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be created. [ 957.573646] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.573646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.573646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.573646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.574303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.586024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: UNINITIALIZED for 2s [ 958.031233] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 958.031467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106876] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a76c14ac-beec-42eb-9048-8907b45f08c8 None None] Enqueued Resource ID: 38e10002-f298-4952-bf60-8935ba54b164 with Priority: HIGHEST for action port [ 959.107471] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e10002-f298-4952-bf60-8935ba54b164 with Priority: HIGHEST for action port [ 959.107781] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e10002-f298-4952-bf60-8935ba54b164 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.107904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e10002-f298-4952-bf60-8935ba54b164" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.108035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e10002-f298-4952-bf60-8935ba54b164" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.108257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e10002-f298-4952-bf60-8935ba54b164" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.108342] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e10002-f298-4952-bf60-8935ba54b164',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.596506] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 959.596737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.596931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.597295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.597502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.597622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.597682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.597840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.597920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598135] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.612908] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38e10002-f298-4952-bf60-8935ba54b164 [ 959.613165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.613298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.613375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.613565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.613649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.613745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38e10002-f298-4952-bf60-8935ba54b164 already deleted. [ 959.613820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e10002-f298-4952-bf60-8935ba54b164" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.034522] env[65738]: INFO networking_nsxv3.common.synchronization [None req-44429601-1514-476a-b5e0-65cf3200e73c tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 960.035527] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 960.035527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.035876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.035966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.036236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.036369] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.101843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.101951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.102062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.102870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.102870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.102870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.102870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.102870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.102870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.103970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.103970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.103970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.103970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.105962] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.105962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.105962] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.190649] env[65738]: INFO networking_nsxv3.common.synchronization [None req-73c12347-3517-475f-8ed0-40f49f2dc22e tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 960.191169] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 960.191169] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.191169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.558063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.558837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.559101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.559524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.559709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.559969] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b already deleted. [ 960.561300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.561909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.561981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.562028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.610022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 664447af-cc63-464d-83e7-bc563a3e53c3: rpc.has_security_group_logging(os_id): False [ 960.630365] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.630543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.630584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.630823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.630903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.631094] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.631190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.631240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.631448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.631534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.631806] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.631973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.632126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.632202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.632385] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.632627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.632627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.632696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.632727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.632803] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be created. [ 960.699638] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.699873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.699943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.700225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.700426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.712943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 961.087276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.087416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.087611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.087690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.087777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.087871] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b already deleted. [ 961.088140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.138094] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fbb54e6-0c7e-4930-9873-b3ac0e9408f2 req-50827dd3-229a-4a2b-b1f7-dc00592f8178 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 961.141326] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 961.141752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.142121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.142121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.143024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.143024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.143266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.143266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.143266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.144020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.144020] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.647414] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.647815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.647815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.647932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.647932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.649359] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.649359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.649359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.649359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.649359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.649359] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 961.690183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.690183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.690183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.690183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.690183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.702810] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 961.740837] env[65738]: INFO networking_nsxv3.common.synchronization [None req-aa2d0e4d-ad50-443b-b83e-5df541546c2c None None] Enqueued Resource ID: 93e7273d-7557-4424-bcad-d467f745a6e1 with Priority: HIGHEST for action port [ 961.741542] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e7273d-7557-4424-bcad-d467f745a6e1 with Priority: HIGHEST for action port [ 961.741788] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-93e7273d-7557-4424-bcad-d467f745a6e1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.741925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93e7273d-7557-4424-bcad-d467f745a6e1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.741925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93e7273d-7557-4424-bcad-d467f745a6e1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.742586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93e7273d-7557-4424-bcad-d467f745a6e1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.742673] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93e7273d-7557-4424-bcad-d467f745a6e1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.245377] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93e7273d-7557-4424-bcad-d467f745a6e1 [ 962.245909] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.245909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.245909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.248683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.248904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.249115] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93e7273d-7557-4424-bcad-d467f745a6e1 already deleted. [ 962.249282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93e7273d-7557-4424-bcad-d467f745a6e1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.725365] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 962.726345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.716243] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 963.716243] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 963.716243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.350786] env[65738]: INFO networking_nsxv3.common.synchronization [None req-e1fb415d-8d5a-4845-90d7-27de07bff3e0 None None] Enqueued Resource ID: 9e594be0-28ba-42de-9e93-d934ca139531 with Priority: HIGHEST for action port [ 966.351446] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e594be0-28ba-42de-9e93-d934ca139531 with Priority: HIGHEST for action port [ 966.351947] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e594be0-28ba-42de-9e93-d934ca139531 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.352103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e594be0-28ba-42de-9e93-d934ca139531" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.352170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e594be0-28ba-42de-9e93-d934ca139531" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.352441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e594be0-28ba-42de-9e93-d934ca139531" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.352597] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e594be0-28ba-42de-9e93-d934ca139531',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.857277] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e594be0-28ba-42de-9e93-d934ca139531 [ 966.857277] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.857277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.857277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.857277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.857277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.857277] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e594be0-28ba-42de-9e93-d934ca139531 already deleted. [ 966.857277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e594be0-28ba-42de-9e93-d934ca139531" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.524925] env[65738]: INFO networking_nsxv3.common.synchronization [None req-f3d33dfb-d517-4862-be8e-5176cc9be2dc tempest-ServersTestJSON-1562028512 tempest-ServersTestJSON-1562028512-project-member] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 967.525602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 967.526535] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.526535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.526535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.526535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.526535] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.684323] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a04ac84e-192e-4163-be22-213e50c7528e tempest-ServersTestJSON-1562028512 tempest-ServersTestJSON-1562028512-project-member] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 967.684323] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 967.684323] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.684323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.749945] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4dd99e3-aa18-4ba3-85a3-2fc6bac45047 req-a73a97d6-73d7-48b7-9fae-481dd69e9a85 tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 967.750633] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 967.750837] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.750957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.751477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.751725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.752044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.752134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.752183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.752309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.752395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.752509] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.051667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.051836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.051877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.052383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.052383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.052383] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 already deleted. [ 968.052536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.052622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.052783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.052867] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.255140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.255290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.255387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.255606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.256751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.256751] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.256751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.256751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.256751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.256751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.256751] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 968.262072] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.262307] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.262458] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.262745] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.263084] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.263390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.263560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.263825] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.264013] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.264257] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.264399] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.264536] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.264654] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.264781] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.264913] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.265077] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.288625] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.288625] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.288625] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.288625] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-173" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.289632] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-fe609930-9619-44c7-bef6-bc0da6efbfdd taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.289632] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.289632] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.289922] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.289922] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe609930-9619-44c7-bef6-bc0da6efbfdd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.304634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.304634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.304796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.304935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.305400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.316979] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 968.579607] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.579949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.579949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.580095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.580160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.580214] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 already deleted. [ 968.580342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.792421] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.792976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.792976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.793855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.793855] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.793855] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port fe609930-9619-44c7-bef6-bc0da6efbfdd not found, creating... [ 968.794257] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.794372] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.794425] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.794746] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.796155] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.797223] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.797353] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.797652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.797942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.798230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.798409] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: fe609930-9619-44c7-bef6-bc0da6efbfdd is going to be created. [ 968.822517] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.822517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.822517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.822517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.822517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.822517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.983275] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b4b70b36-b646-4e31-bdc6-2c4c79fd28a1 None None] Enqueued Resource ID: dd4406a1-b3c9-41b1-aa86-c5c1a378a855 with Priority: HIGHEST for action port [ 968.983896] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd4406a1-b3c9-41b1-aa86-c5c1a378a855 with Priority: HIGHEST for action port [ 968.984242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd4406a1-b3c9-41b1-aa86-c5c1a378a855 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.984413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd4406a1-b3c9-41b1-aa86-c5c1a378a855" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.984523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd4406a1-b3c9-41b1-aa86-c5c1a378a855" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.984773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd4406a1-b3c9-41b1-aa86-c5c1a378a855" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.984857] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd4406a1-b3c9-41b1-aa86-c5c1a378a855',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.487680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd4406a1-b3c9-41b1-aa86-c5c1a378a855 [ 969.487986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.488233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.488233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.488904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.488904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.488904] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd4406a1-b3c9-41b1-aa86-c5c1a378a855 already deleted. [ 969.488904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd4406a1-b3c9-41b1-aa86-c5c1a378a855" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.544179] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4dd99e3-aa18-4ba3-85a3-2fc6bac45047 req-8cf1294a-5b06-48b4-9b9f-bb606fc9b3dd service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 969.544317] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4dd99e3-aa18-4ba3-85a3-2fc6bac45047 req-8cf1294a-5b06-48b4-9b9f-bb606fc9b3dd service nova] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 969.544460] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4dd99e3-aa18-4ba3-85a3-2fc6bac45047 req-8cf1294a-5b06-48b4-9b9f-bb606fc9b3dd service nova] Enqueued Resource ID: fe609930-9619-44c7-bef6-bc0da6efbfdd with Priority: HIGHEST for action port [ 969.546159] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_rules [ 969.546231] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 969.546324] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe609930-9619-44c7-bef6-bc0da6efbfdd with Priority: HIGHEST for action port [ 969.546652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.546723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.546794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.546995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.547090] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.549022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.549022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.549022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe609930-9619-44c7-bef6-bc0da6efbfdd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.549022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.549022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.549022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.549380] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe609930-9619-44c7-bef6-bc0da6efbfdd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.051569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.051569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.051926] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe609930-9619-44c7-bef6-bc0da6efbfdd with status ACTIVE [ 970.051926] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.052191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.052191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.052261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.052348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.052521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.052617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.052679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.052828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.052911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.053366] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.053366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.053366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.053366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.053673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.053673] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe609930-9619-44c7-bef6-bc0da6efbfdd is going to be updated. [ 970.083187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.083363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.083404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.083602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.083802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.084055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe609930-9619-44c7-bef6-bc0da6efbfdd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.166937] env[65738]: INFO networking_nsxv3.common.synchronization [req-e4a006b8-3b58-4870-a10e-db6f6fa11dde req-2fc808f9-5c61-4ed8-9e55-9db05fb7904c tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 970.167338] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 970.168188] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.168188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.168188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.168188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.168684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.168684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.168684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.168684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.168684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.168859] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.328439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 970.328623] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 deletion is rescheduled due to dependency. [ 970.328686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.328858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.329178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.329498] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.329659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.329659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.329906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.329906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.330111] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.560317] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.560554] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.560674] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.560984] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.561289] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.561449] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.561568] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.561824] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.561997] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.562799] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.562930] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.563079] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.563193] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.563319] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.563429] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.563570] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.583983] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.584201] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 970.584340] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.584531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.584857] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-d6c4e69d-6faf-4160-842d-c65dd9007f3f taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.585056] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.585178] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.585516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.585667] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c4e69d-6faf-4160-842d-c65dd9007f3f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.674057] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.674057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.674057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.674057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.674057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.674265] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.674324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.674385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.674540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.674613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.674719] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d9f780-2387-4768-9bde-778929c0c06d already deleted. [ 970.674802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.832854] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.090313] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.090313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port d6c4e69d-6faf-4160-842d-c65dd9007f3f not found, creating... [ 971.090313] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.090313] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.090870] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.090870] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.090954] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.091130] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.091271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.091415] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: d6c4e69d-6faf-4160-842d-c65dd9007f3f is going to be created. [ 971.115666] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.116348] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.116569] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.117569] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.117810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.118830] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.334680] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.839101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.839441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.839562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.839791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.839932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.840113] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 971.885510] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.885510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.885510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.885510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.885510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.900700] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 971.925090] env[65738]: INFO networking_nsxv3.common.synchronization [req-e4a006b8-3b58-4870-a10e-db6f6fa11dde req-52fc0b94-7f37-4800-84bf-0fda81448616 service nova] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 971.925090] env[65738]: INFO networking_nsxv3.common.synchronization [req-e4a006b8-3b58-4870-a10e-db6f6fa11dde req-52fc0b94-7f37-4800-84bf-0fda81448616 service nova] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 971.925090] env[65738]: INFO networking_nsxv3.common.synchronization [req-e4a006b8-3b58-4870-a10e-db6f6fa11dde req-52fc0b94-7f37-4800-84bf-0fda81448616 service nova] Enqueued Resource ID: d6c4e69d-6faf-4160-842d-c65dd9007f3f with Priority: HIGHEST for action port [ 971.925583] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_rules [ 971.925743] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 971.925872] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c4e69d-6faf-4160-842d-c65dd9007f3f with Priority: HIGHEST for action port [ 971.926182] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.927209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.927209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.927209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.927209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.927780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.927901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.927974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.928240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.928384] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.928489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.928552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.928694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.928795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.928894] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.929800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6c4e69d-6faf-4160-842d-c65dd9007f3f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.930777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.930888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.931100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.931210] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c4e69d-6faf-4160-842d-c65dd9007f3f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.432776] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.434412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.434619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.435170] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6c4e69d-6faf-4160-842d-c65dd9007f3f with status ACTIVE [ 972.435433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.435597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.435705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.435980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.436126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.436364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.436531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.436594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.436781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.436919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.437188] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.437399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.437507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.437700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.437806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.437940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6c4e69d-6faf-4160-842d-c65dd9007f3f is going to be updated. [ 972.465186] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.465367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.465431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.465603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.465752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.465930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6c4e69d-6faf-4160-842d-c65dd9007f3f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.936148] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.291859] env[65738]: INFO networking_nsxv3.common.synchronization [req-b206295c-1a51-4698-b831-b50028392a29 req-9d500c04-8417-4c21-bfe9-89cf956650c1 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 973.291994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGHEST for action security_group_members [ 973.292402] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.294455] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.294455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.294455] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.441358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.441358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.441358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.441358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.441358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.441358] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d9f780-2387-4768-9bde-778929c0c06d is going to be created. [ 973.467150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.467288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.467409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.467571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.467729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.479277] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: UNINITIALIZED for 2s [ 973.796960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.796960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.796960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.796960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.823430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.824397] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.824397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.824397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.824397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.824397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.824397] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d is going to be updated. [ 973.857914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.858114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.858226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.858507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.858702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.868709] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: IN_PROGRESS for 2s [ 973.910699] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 973.910930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.911114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.911334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.911554] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.911695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.911762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.911908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.911992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.912076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.912266] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.414832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.414983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.415092] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.415648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.416487] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.416487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.416487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.416487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.416487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.416487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.416487] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.416719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.416719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.416719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.416868] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.417020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.417114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.417273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.417535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.417655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.417777] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.920031] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b62a35a-29b0-4826-a035-6eed21356980: rpc.has_security_group_logging(os_id): False [ 974.940131] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.940131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.940131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.940341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.940341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.940643] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.940753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.940815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941240] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.941531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.941603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.941790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.942094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.942165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.942250] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 975.078597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.078773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.078847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.079073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.079226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.098991] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 975.493042] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: SUCCESS [ 975.493272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.493438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.493659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.493852] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.493966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.494042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.494198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.494339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.494339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.494440] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.879415] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d in Status: SUCCESS [ 975.879673] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d deletion is rescheduled due to dependency. [ 975.879791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.999034] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.431018] env[65738]: INFO networking_nsxv3.common.synchronization [req-48d359e9-0a6e-493d-b6aa-3fcc12619511 req-d5ca5575-c332-4bee-8362-28a4ec727500 tempest-ServersAdminTestJSON-1981750160 tempest-ServersAdminTestJSON-1981750160-project-member] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 976.431689] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGHEST for action security_group_members [ 976.432117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.432240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.432306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.432590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.432684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.432798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.432870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.434027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.434027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.434027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.502455] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7d9f780-2387-4768-9bde-778929c0c06d: rpc.has_security_group_logging(os_id): False [ 976.522887] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.523157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.523157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.525020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.525020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.525020] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d9f780-2387-4768-9bde-778929c0c06d is going to be created. [ 976.612712] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.612871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.612966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.613213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.613410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.639642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: IN_PROGRESS for 2s [ 976.936609] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.936832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.936897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.937150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.962355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.962355] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.962355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.962355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.962355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.962355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.962692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be updated. [ 976.994826] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.995021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.995069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.995293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.995437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.004139] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: IN_PROGRESS for 2s [ 977.121812] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 977.122077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.653287] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: SUCCESS [ 978.653620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.016054] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b in Status: SUCCESS [ 979.016256] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b deletion is rescheduled due to dependency. [ 979.016432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.036349] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd04e144-5dd9-4cee-8cd6-d764b12d1f55 req-ab75ee76-54b7-41d0-ac75-ae973b770486 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 979.037183] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 979.037604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.037750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.037819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.038046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.038211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.038343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.038381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.038527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.038674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.038710] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.541539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.541713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.541836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.542780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.542780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.542780] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 979.574770] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.574770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.574770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.574770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.574770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.583264] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 981.599025] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 981.599402] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 981.599515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.681259] env[65738]: INFO networking_nsxv3.common.synchronization [req-f55f823a-dd6c-4a15-b299-25a25e8c3061 req-5f7c21b7-dc25-48d6-b71d-c02b23cc6725 tempest-ImagesOneServerNegativeTestJSON-1046305621 tempest-ImagesOneServerNegativeTestJSON-1046305621-project-member] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 981.681259] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGHEST for action security_group_members [ 981.681606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.681675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.681726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.681912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.682266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.682266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682541] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.185015] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.185247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.185323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.185545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.185732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.185871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.186344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.186344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.186464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.186494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.186663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be updated. [ 982.265387] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.266445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.266445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.266445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.266445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.278042] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: IN_PROGRESS for 2s [ 984.288865] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b62a35a-29b0-4826-a035-6eed21356980 in Status: SUCCESS [ 984.289228] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 deletion is rescheduled due to dependency. [ 984.289228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.398674] env[65738]: INFO networking_nsxv3.common.synchronization [req-80611403-c6f6-4107-9d65-484dba872a02 req-09e66f80-2378-4d60-b7a7-c0831e9365d5 tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 984.398674] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 984.398923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.399214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.399387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.399800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.400047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.400229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.400334] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.400540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.400671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.400901] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.799923] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.800158] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.800284] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.800613] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.800962] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.801306] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.801433] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.801662] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.801809] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.802033] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.802178] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.802297] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.802405] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.802516] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.802620] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.802755] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.824137] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.824313] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.824366] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.824585] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.825046] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-96a9491d-607d-463b-90d8-c541bc8faaf5 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.825255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.825386] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.825732] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.825874] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9491d-607d-463b-90d8-c541bc8faaf5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.906850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.907066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.907127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.907313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.907403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.907599] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.907697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.907778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.907975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.908065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.908155] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b already deleted. [ 984.908236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.015579] env[65738]: INFO networking_nsxv3.common.synchronization [req-5a18a5cb-8196-4efa-92e6-4dd58fe7c03e req-990db2ca-30ad-4b4a-a025-2716ffbc4d31 tempest-ServersNegativeTestJSON-2088787331 tempest-ServersNegativeTestJSON-2088787331-project-member] Enqueued Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 985.016172] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 with Priority: HIGHEST for action security_group_members [ 985.016968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.016968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.016968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.016968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.017977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.018103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.018233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.018407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.018494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.018580] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89618efc-1c71-4f3b-9cfc-d651fcf1fe99',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.328851] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.329215] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.329262] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.329556] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.329686] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.329881] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 96a9491d-607d-463b-90d8-c541bc8faaf5 not found, creating... [ 985.330164] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.330320] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.330432] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.330648] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.330802] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.331112] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.331274] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.331385] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.331588] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.331720] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.331865] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 96a9491d-607d-463b-90d8-c541bc8faaf5 is going to be created. [ 985.357186] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.357442] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.357568] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.358078] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.358414] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.358675] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.523050] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.523050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.523050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.523385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.523385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.523591] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.523730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.523810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.523929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.524024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.524129] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 is going to be updated. [ 985.553804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.553804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.553804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.554011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.554591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.563071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: IN_PROGRESS for 2s [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [req-80611403-c6f6-4107-9d65-484dba872a02 req-a9bbb9a6-ece0-4605-9054-5fa676dfb7d6 service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [req-80611403-c6f6-4107-9d65-484dba872a02 req-a9bbb9a6-ece0-4605-9054-5fa676dfb7d6 service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [req-80611403-c6f6-4107-9d65-484dba872a02 req-a9bbb9a6-ece0-4605-9054-5fa676dfb7d6 service nova] Enqueued Resource ID: 96a9491d-607d-463b-90d8-c541bc8faaf5 with Priority: HIGHEST for action port [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 986.099277] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a9491d-607d-463b-90d8-c541bc8faaf5 with Priority: HIGHEST for action port [ 986.099277] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.099277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.099702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.100220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.100403] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.101346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.101618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.101780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.102034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.102275] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.102557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.102708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.102991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.103209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.103390] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.104822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a9491d-607d-463b-90d8-c541bc8faaf5 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.105096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.105265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.105636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.106541] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9491d-607d-463b-90d8-c541bc8faaf5',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.610708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96a9491d-607d-463b-90d8-c541bc8faaf5 with status ACTIVE [ 986.611095] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.611323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.611437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.611664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.611752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.611939] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.613141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.613141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.613540] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96a9491d-607d-463b-90d8-c541bc8faaf5 is going to be updated. [ 986.614833] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.614944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.615116] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.641849] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.642098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.642098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.642277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.642408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.642567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a9491d-607d-463b-90d8-c541bc8faaf5" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.117236] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.574510] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 in Status: SUCCESS [ 987.574699] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89618efc-1c71-4f3b-9cfc-d651fcf1fe99 deletion is rescheduled due to dependency. [ 987.574810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89618efc-1c71-4f3b-9cfc-d651fcf1fe99" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.620371] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.623114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.623114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.623114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.623114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.623114] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be created. [ 987.649173] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.649367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.649468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.649725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.649982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.664247] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: UNINITIALIZED for 2s [ 987.952169] env[65738]: INFO networking_nsxv3.common.synchronization [req-46a6db26-3495-4aed-926f-372bf7749a63 req-35e718b4-6fbf-4b75-9057-a7ac9c7be166 tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 987.952994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 987.953432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.953432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.953432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.954188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.954188] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.954188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.954471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.954577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.954699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.954827] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.457127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.457345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.457413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.457733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.495494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.495843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.495991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.496109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.496383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.496383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.496616] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 988.560029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.560029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.560201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.560379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.560549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.578692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 989.366135] env[65738]: INFO networking_nsxv3.common.synchronization [req-4c1a683b-1606-43e7-80d0-848138908803 req-faedea10-b9d7-41f3-8baa-0b66151fce32 tempest-FloatingIPsAssociationTestJSON-1664428748 tempest-FloatingIPsAssociationTestJSON-1664428748-project-member] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 989.366732] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 989.368136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.368680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.368793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.369277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.369491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.369680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.369773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.370111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.370279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.370452] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.658638] env[65738]: INFO networking_nsxv3.common.synchronization [req-cd84975b-ebd6-40b0-bd11-db7cd0106ac4 req-9bc62db7-3ea1-4678-bd0f-ab069ec81180 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 989.659210] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 989.659507] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.659630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.659688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.659889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.660088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.660197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.660310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.660560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.660560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.660657] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.674920] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 989.675152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.675581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.675789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.675975] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.676100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.676161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.676309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.676418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.676470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.676545] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.700796] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-213 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.701057] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701162] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.701451] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.701704] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.701861] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.701979] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.702207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.702353] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.702556] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.702670] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.702771] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.702877] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.702985] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.703107] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.703234] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.741841] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.742065] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.742239] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.742419] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-213" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.742740] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-36900c8b-e496-49b3-997f-99f4413684f4 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.742906] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.743036] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.743374] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.743511] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36900c8b-e496-49b3-997f-99f4413684f4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.873383] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.163488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.163707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.163805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.164070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.164218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.164462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.164590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.164660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.164865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.164968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.165105] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 990.180369] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.195683] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.195877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.195877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.196116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.196261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.209395] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 990.246173] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.246410] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.246410] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.248520] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 36900c8b-e496-49b3-997f-99f4413684f4 not found, creating... [ 990.248520] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.248520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.248943] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.248943] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.249107] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.249523] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.249523] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.250886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 36900c8b-e496-49b3-997f-99f4413684f4 is going to be created. [ 990.277354] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.277615] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.277728] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.278030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.278284] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.278522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.375605] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.588485] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 990.588697] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d deletion is rescheduled due to dependency. [ 990.588809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.683658] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b: rpc.has_security_group_logging(os_id): False [ 990.707225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.707371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.707448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.707661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.707744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.708020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.708127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.708182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.708355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.708430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.708518] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be created. [ 990.780385] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.780564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.780634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.781129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.781129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.808937] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 990.882121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.882121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.882121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.882121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.882121] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.882121] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be updated. [ 990.937460] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.940444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.940444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.940444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.940444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.948734] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 991.086212] env[65738]: INFO networking_nsxv3.common.synchronization [req-4c1a683b-1606-43e7-80d0-848138908803 req-5200f9cc-53a4-446f-b7ba-ce2844af56f7 service nova] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_rules [ 991.086472] env[65738]: INFO networking_nsxv3.common.synchronization [req-4c1a683b-1606-43e7-80d0-848138908803 req-5200f9cc-53a4-446f-b7ba-ce2844af56f7 service nova] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 991.086625] env[65738]: INFO networking_nsxv3.common.synchronization [req-4c1a683b-1606-43e7-80d0-848138908803 req-5200f9cc-53a4-446f-b7ba-ce2844af56f7 service nova] Enqueued Resource ID: 36900c8b-e496-49b3-997f-99f4413684f4 with Priority: HIGHEST for action port [ 991.087286] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_rules [ 991.087420] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 991.087570] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36900c8b-e496-49b3-997f-99f4413684f4 with Priority: HIGHEST for action port [ 991.087911] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.088272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.088272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.088388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.088473] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.089549] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.089665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.089933] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-36900c8b-e496-49b3-997f-99f4413684f4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.090125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.090237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.090417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.090482] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36900c8b-e496-49b3-997f-99f4413684f4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.592235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.592535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.592680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36900c8b-e496-49b3-997f-99f4413684f4 with status ACTIVE [ 991.592954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.592954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.593144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.593242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.593327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.593540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.593643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.593699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.593853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.593929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.594124] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.594223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.594271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.594406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.594478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.594587] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36900c8b-e496-49b3-997f-99f4413684f4 is going to be updated. [ 991.618652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.618821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.618821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.618949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.619116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.619262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36900c8b-e496-49b3-997f-99f4413684f4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.885387] env[65738]: INFO networking_nsxv3.common.synchronization [req-9bbe640b-9a72-496d-8065-a5243c9ffe97 req-025f6b7c-714e-42bb-b279-5380b46bb8e7 tempest-ServersTestJSON-1562028512 tempest-ServersTestJSON-1562028512-project-member] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 991.885942] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 991.886287] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.886409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.886474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.886899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.887083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.887194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.887284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.887441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.887527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.887643] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.219855] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 4s [ 992.267616] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-957 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.267849] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-957" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.268138] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-957" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.268570] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-957" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.268966] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.269218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.269543] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.269664] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.269774] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.270064] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.270232] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.270364] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.270472] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.270588] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.270693] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.270829] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.292597] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.292770] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.292905] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.293114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-957" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.293470] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-0d9a0f04-e61d-485b-b63a-04729997d341 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.293646] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.293765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.295810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.295964] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9a0f04-e61d-485b-b63a-04729997d341',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.390255] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.390456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.390534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.390781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.390896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.391156] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.391281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.391354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.391543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.391621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.391723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 already deleted. [ 992.391814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.798474] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.798781] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.798817] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.799104] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.799287] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.799415] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 0d9a0f04-e61d-485b-b63a-04729997d341 not found, creating... [ 992.799673] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.799832] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.799957] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.800277] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.800423] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.800732] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.800889] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.800984] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.803687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.804259] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.804835] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 0d9a0f04-e61d-485b-b63a-04729997d341 is going to be created. [ 992.827747] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 992.827847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.836715] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.837716] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.838164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.838309] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.838653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.838816] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.959596] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 992.959850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.960062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.960339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.960534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.960656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.960722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.960871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.960942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.961064] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.463434] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [req-9bbe640b-9a72-496d-8065-a5243c9ffe97 req-144e3757-8275-4d4a-ab6f-9a5d1313e810 service nova] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [req-9bbe640b-9a72-496d-8065-a5243c9ffe97 req-144e3757-8275-4d4a-ab6f-9a5d1313e810 service nova] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [req-9bbe640b-9a72-496d-8065-a5243c9ffe97 req-144e3757-8275-4d4a-ab6f-9a5d1313e810 service nova] Enqueued Resource ID: 0d9a0f04-e61d-485b-b63a-04729997d341 with Priority: HIGHEST for action port [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_rules [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 993.574491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d9a0f04-e61d-485b-b63a-04729997d341 with Priority: HIGHEST for action port [ 993.574491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.574491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.574909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.575248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.575457] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.577226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.577522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.577684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.578079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.578383] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.578678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.579026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.579127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.579293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.579922] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.580783] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d9a0f04-e61d-485b-b63a-04729997d341 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.580783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.580783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.581079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.581079] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d9a0f04-e61d-485b-b63a-04729997d341',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.966585] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.084565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.085074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.085742] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.086861] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d9a0f04-e61d-485b-b63a-04729997d341 with status ACTIVE [ 994.087421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.087567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.087635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.087853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.087942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.088233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.088336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.088401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.088570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.088649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.088860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.088957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.089047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.089196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.089272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.089359] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d9a0f04-e61d-485b-b63a-04729997d341 is going to be updated. [ 994.115020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.115184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.115184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.115419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.115835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.115835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d9a0f04-e61d-485b-b63a-04729997d341" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.232590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 994.232787] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 994.232912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.275343] env[65738]: INFO networking_nsxv3.common.synchronization [req-3f272af8-925e-4aa9-af3f-3f537de0dc92 req-35f8140b-14a5-44fd-8ce1-07c06db6d71d tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 994.276576] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 994.276906] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.277059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.277105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.277301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.277499] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.277607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.277665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.278312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.278312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.278312] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.468711] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.469304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.469519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.469613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.469701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.469821] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be updated. [ 994.505752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.505752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.505752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.505752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.505752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.551647] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 994.592383] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.685374] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.685662] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.685854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.686273] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.686659] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.686896] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.687094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.687425] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.687667] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.687991] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.688194] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.688375] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.688568] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.689309] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.689542] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.689936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.712901] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.713093] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.713269] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.713399] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.713721] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-edf04c70-a3d2-4db3-84ed-bcc191399e1c taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.713896] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.714034] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.714431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.714691] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edf04c70-a3d2-4db3-84ed-bcc191399e1c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.781142] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.095044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.095299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.095299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.095494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.095583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.095686] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 is going to be created. [ 995.129763] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.129924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.129973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.130292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.130474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.152446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: UNINITIALIZED for 2s [ 995.224135] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.224135] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port edf04c70-a3d2-4db3-84ed-bcc191399e1c not found, creating... [ 995.224135] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.224135] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.224737] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.229609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.229609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.229609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.229609] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.229609] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: edf04c70-a3d2-4db3-84ed-bcc191399e1c is going to be created. [ 995.261303] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.261588] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.261717] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263590] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.263590] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.263590] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.283977] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.786494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.786674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.786767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.787014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.787143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.787267] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 995.818181] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.818456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.818558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.818820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.818982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.834681] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 995.983949] env[65738]: INFO networking_nsxv3.common.synchronization [req-3f272af8-925e-4aa9-af3f-3f537de0dc92 req-9415c7f4-4e34-4f78-8d08-a9cf142ce086 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 995.984157] env[65738]: INFO networking_nsxv3.common.synchronization [req-3f272af8-925e-4aa9-af3f-3f537de0dc92 req-9415c7f4-4e34-4f78-8d08-a9cf142ce086 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 995.984299] env[65738]: INFO networking_nsxv3.common.synchronization [req-3f272af8-925e-4aa9-af3f-3f537de0dc92 req-9415c7f4-4e34-4f78-8d08-a9cf142ce086 service nova] Enqueued Resource ID: edf04c70-a3d2-4db3-84ed-bcc191399e1c with Priority: HIGHEST for action port [ 995.984861] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 995.985103] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 995.985103] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edf04c70-a3d2-4db3-84ed-bcc191399e1c with Priority: HIGHEST for action port [ 995.985336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.985570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.985570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.985819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.985896] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.987221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.987221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.987221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-edf04c70-a3d2-4db3-84ed-bcc191399e1c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.987221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.987589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.987589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.987589] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edf04c70-a3d2-4db3-84ed-bcc191399e1c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.489477] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.489865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.489865] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edf04c70-a3d2-4db3-84ed-bcc191399e1c with status ACTIVE [ 996.490049] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.490185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.490252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.490511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.490704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.490838] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.490940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.490995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.491425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.491425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.491508] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.491664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.491664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.491816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.491865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.491921] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edf04c70-a3d2-4db3-84ed-bcc191399e1c is going to be updated. [ 996.516219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.516529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.516529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.516703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.516765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.516925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edf04c70-a3d2-4db3-84ed-bcc191399e1c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.559837] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 996.560061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.560310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.560541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.560746] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.560853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.560938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.561114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.561461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.561461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.561461] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.926626] env[65738]: INFO networking_nsxv3.common.synchronization [None req-63c55562-c008-4f78-869a-7627c78cca5c tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 996.927212] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 996.927519] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.927637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.927707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.927959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.928054] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.018722] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0d005bb9-8cb6-42a4-9ab1-c88c56c91504 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 997.019372] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 997.019749] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.019865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.064263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.064463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.064536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.064761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.064936] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.065047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.065111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.065258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.065375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.065473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.065627] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.065726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.065776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.065911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.066080] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.066172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.066232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.066372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.066445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.066585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.066639] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.168691] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: SUCCESS [ 997.168918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.169141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.169336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.169536] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.169653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.169733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.169892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.170054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.170165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.170165] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.454024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.454024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.454024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.454024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.454024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.454308] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23565e98-53ea-4113-9741-85efc55da889 already deleted. [ 997.454308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.454308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.454496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.454540] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.568823] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 664447af-cc63-464d-83e7-bc563a3e53c3: rpc.has_security_group_logging(os_id): False [ 997.588044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.588232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.588300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.588574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.588627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.588876] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.588942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.588992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.589163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.589248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.589416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.589519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.590035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.590035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.590035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.590035] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.590260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.590260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.590260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.590355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.590416] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be updated. [ 997.657415] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.657647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.657647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.657813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.657968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.673035] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.675263] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 997.847857] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 997.848158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.848409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.848664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.848874] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.849032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.849140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.849371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.849507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.849633] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.977533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.977731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.977768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.977974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.978077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.978216] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23565e98-53ea-4113-9741-85efc55da889 already deleted. [ 997.978317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.176943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cea2a24-1c24-47dc-87cf-758c1ad81488: rpc.has_security_group_logging(os_id): False [ 998.195536] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.195760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.195863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.196152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.196259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.196511] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.196727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.196727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.196863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.196863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.196955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 is going to be created. [ 998.260012] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.260201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.260323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.260555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.260753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.273707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: IN_PROGRESS for 2s [ 998.352323] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.854441] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.358621] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.358710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.358788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.359347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.359347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.359347] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 999.386083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.386243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.386315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.386496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.386641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.395959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 999.693429] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 999.693560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.938208] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 999.938471] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1000.289538] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: SUCCESS [ 1000.289981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.406564] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1001.406564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.406564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.406959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.406959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.407060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.407129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.407289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.407367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.407452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.407542] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.910812] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.911924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.912071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.912652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.912652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.912652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.912830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.912830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.913045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.913045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.913168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.913266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.913322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.913531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.913701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.913794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.913895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.913988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.914077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.914158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.914247] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.019946] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.020227] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1002.417212] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1002.438374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.438520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.438812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.439060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.439186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.439356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.439459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.439522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.439670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.439744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.439983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.440112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.440177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.440322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.440420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.440670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.440781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.440865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.441099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.441197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.441285] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1002.536566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.536808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.536808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.537115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.537115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.606599] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1003.061591] env[65738]: INFO networking_nsxv3.common.synchronization [req-569691ac-dccd-47ae-af11-7e875fba3483 req-265ae74d-8480-4456-a2ee-a20027c2aa60 tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1003.062014] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1003.062819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.062970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.063068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.063297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.063467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.063573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.063634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.063772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.063848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.063941] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.495306] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.495640] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.495640] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.495871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.496139] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.496296] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.496410] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.496620] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.496766] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.496974] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.497112] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.497223] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.497482] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.497534] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.497628] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.497761] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.519886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.520060] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.520248] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.520382] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.520783] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.520987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.521085] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.521616] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.521749] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27d9316-3856-40b5-8b1e-a44e6ec5e23e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.568729] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.568887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.568949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.569174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.569265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.569473] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.569575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.569639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.569813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.569892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.569988] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 1003.614680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.614680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.614680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.615058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.615058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.626399] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 1004.024752] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.024752] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.024752] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.027021] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port a27d9316-3856-40b5-8b1e-a44e6ec5e23e not found, creating... [ 1004.027021] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.027021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.027021] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.027868] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.030907] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.030907] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.030907] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.030907] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: a27d9316-3856-40b5-8b1e-a44e6ec5e23e is going to be created. [ 1004.062482] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.062482] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.062482] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.062482] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.062785] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.062985] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.626083] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1004.626083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.762988] env[65738]: INFO networking_nsxv3.common.synchronization [req-569691ac-dccd-47ae-af11-7e875fba3483 req-f7fa1ac0-c61a-422e-b031-0102880870b4 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 1004.763111] env[65738]: INFO networking_nsxv3.common.synchronization [req-569691ac-dccd-47ae-af11-7e875fba3483 req-f7fa1ac0-c61a-422e-b031-0102880870b4 service nova] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1004.763296] env[65738]: INFO networking_nsxv3.common.synchronization [req-569691ac-dccd-47ae-af11-7e875fba3483 req-f7fa1ac0-c61a-422e-b031-0102880870b4 service nova] Enqueued Resource ID: a27d9316-3856-40b5-8b1e-a44e6ec5e23e with Priority: HIGHEST for action port [ 1004.763884] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_rules [ 1004.765191] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1004.765191] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a27d9316-3856-40b5-8b1e-a44e6ec5e23e with Priority: HIGHEST for action port [ 1004.766922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.766922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.766922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.766922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.766922] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.769499] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769499] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.769499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.769499] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27d9316-3856-40b5-8b1e-a44e6ec5e23e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.271618] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.271781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.271980] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a27d9316-3856-40b5-8b1e-a44e6ec5e23e with status ACTIVE [ 1005.272166] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.272269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.272329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.272551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.272647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.272947] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.272947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.273110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.273158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.273214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.273393] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.273484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.273541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.273730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.273840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.273934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a27d9316-3856-40b5-8b1e-a44e6ec5e23e is going to be updated. [ 1005.296464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.296607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.296671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.296881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.297035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.297200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a27d9316-3856-40b5-8b1e-a44e6ec5e23e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.636594] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 1005.637037] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 1005.637037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.637200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.637486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.637726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.637871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.637950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.638167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.638259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.638465] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.141679] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.371977] env[65738]: INFO networking_nsxv3.common.synchronization [req-e52df5f2-c54d-4f13-9ed5-f6bf0c51e056 req-55451fb3-38a5-47f2-9af2-eac11438614b tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1006.372925] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1006.373298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.373424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.373495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.373728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.373901] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.374020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.374089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.374253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.374339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.374433] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.649402] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.681869] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.682081] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.682303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.682481] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.682732] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.682892] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.683018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.683236] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.683381] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.683694] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.683901] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.684037] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.684151] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.684267] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.684373] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.684507] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.705727] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.705923] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.706069] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.706290] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.706733] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.706960] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.707095] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.707495] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.707637] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58622fe1-5ab5-4cde-8c91-2c3198cbfdab',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.876757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.877064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.877187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.877449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.877547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.877787] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.877887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.877947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.878118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.878238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.878367] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 1006.914992] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.915254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.915371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.915700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.915925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.929234] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1007.152599] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.152792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.152880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.153163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.153276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.153372] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 1007.210591] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.210821] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.210975] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.211291] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.211442] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.211604] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 58622fe1-5ab5-4cde-8c91-2c3198cbfdab not found, creating... [ 1007.211902] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.212075] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.213183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.213183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.213183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.213183] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.213183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.213183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.213441] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.213441] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.213548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 58622fe1-5ab5-4cde-8c91-2c3198cbfdab is going to be created. [ 1007.247040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.247202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.247273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.247487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.247648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.249605] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.249790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.249914] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.250172] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.250388] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.250663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.259502] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 1008.007324] env[65738]: INFO networking_nsxv3.common.synchronization [req-e52df5f2-c54d-4f13-9ed5-f6bf0c51e056 req-16fef597-b10b-4109-9185-b59a8d6d908f service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 1008.008253] env[65738]: INFO networking_nsxv3.common.synchronization [req-e52df5f2-c54d-4f13-9ed5-f6bf0c51e056 req-16fef597-b10b-4109-9185-b59a8d6d908f service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1008.008589] env[65738]: INFO networking_nsxv3.common.synchronization [req-e52df5f2-c54d-4f13-9ed5-f6bf0c51e056 req-16fef597-b10b-4109-9185-b59a8d6d908f service nova] Enqueued Resource ID: 58622fe1-5ab5-4cde-8c91-2c3198cbfdab with Priority: HIGHEST for action port [ 1008.010543] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 1008.010543] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1008.010543] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58622fe1-5ab5-4cde-8c91-2c3198cbfdab with Priority: HIGHEST for action port [ 1008.011370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.011499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.011611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.011817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.011896] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.013488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.013608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.014498] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.014498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.014498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.014498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.014498] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58622fe1-5ab5-4cde-8c91-2c3198cbfdab',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.194399] env[65738]: INFO networking_nsxv3.common.synchronization [req-dd5b9292-fc29-43ec-a3fc-6ef494b0a58c req-17781f8f-3305-4e94-afd0-0093ad573659 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1008.194839] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1008.195234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.195370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.195370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.195514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.195659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.195762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.196498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.199219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.199407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.199551] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.516680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.520022] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58622fe1-5ab5-4cde-8c91-2c3198cbfdab with status ACTIVE [ 1008.520022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.520022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.520022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.520022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.520695] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58622fe1-5ab5-4cde-8c91-2c3198cbfdab is going to be updated. [ 1008.548695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.549731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.549863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.550157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.550309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.550479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58622fe1-5ab5-4cde-8c91-2c3198cbfdab" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.590341] env[65738]: INFO networking_nsxv3.common.synchronization [req-c882a641-5820-4cce-b9c9-c95a6d08556f req-42ed714e-23d1-45d7-8b62-7f1c168d21ae tempest-FloatingIPsAssociationTestJSON-1664428748 tempest-FloatingIPsAssociationTestJSON-1664428748-project-member] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 1008.591120] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 1008.591492] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.591619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.591691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.591889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.592082] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.592192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.592256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.592408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.592509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.592648] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.702277] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.940174] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1008.940174] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 1008.940392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.940436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.940676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.940950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.941030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.941030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.941227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.941299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.941349] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.095226] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.204300] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.274381] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 1009.274381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.274381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.274381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.274381] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.274381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.274381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.274847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.274882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.274974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.275524] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.443924] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.598169] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.707260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.707546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.707711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.708058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.708217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.708365] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1009.761401] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.761551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.761611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.761879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.762155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.776370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1009.782010] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.782299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.782375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.782583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.782750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.783116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.783116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.783282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.783282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.783344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.783503] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.784209] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.784209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.784667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.784667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.786115] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.948269] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.101257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.105111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.105111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.105111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.105111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.105111] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be updated. [ 1010.137994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.138175] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.138242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.138662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.139235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.154090] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 1010.289487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 728b373a-0a9d-4e10-b5ee-d0b6e2a75682: rpc.has_security_group_logging(os_id): False [ 1010.332484] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.332628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.332698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.332912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.333012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.333215] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.333314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.333394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.333584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.333584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.333802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.333930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.333993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.334154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.334222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.334416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.335405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.335405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.335772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.335985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.335985] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 1010.435230] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.435375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.435429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.435637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.435782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.450310] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.450485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.450540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.451529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.452597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.452908] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 1010.455931] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 1010.534276] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.534276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.534276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.534435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.534580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.555212] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1011.799934] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1011.800377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.183337] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 1012.184214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.470996] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 1012.470996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.569649] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1012.570101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.570372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.570637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.570902] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.571060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.571144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.571340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.571432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.571492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.571631] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.077024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.077024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.077024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.077024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.077024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.077996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.077996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.077996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.077996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.077996] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.582688] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 1013.595440] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1013.595560] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1013.604971] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.605142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.605232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.605442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.605751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.605963] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.606076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.606135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.606287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.606365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.606553] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.606649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.606708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.606848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.606915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.607257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.608251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.608318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.608677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.608761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.608957] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 1013.703793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.703793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.703793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.703793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.703793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.722077] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1013.962272] env[65738]: INFO networking_nsxv3.common.synchronization [req-28c4dec5-4c0f-4fc0-aa22-80dc32457572 req-ed842f16-7ea8-418f-afcb-b3a287ed1708 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1013.963153] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1013.963537] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.964636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.964636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.964636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.964636] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.965106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.965106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.965106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.965343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.965343] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.382513] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.382847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.382887] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.383282] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.383629] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.383799] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.383914] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.384173] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.384368] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.384591] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.384705] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.385378] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.385378] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.385378] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.385378] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.385378] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.405914] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.406537] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.406537] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.406537] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-113" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.406876] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-103a5a03-bda9-49e6-be16-9268d486e5d0 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.407067] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.407179] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.407843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.407843] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103a5a03-bda9-49e6-be16-9268d486e5d0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.469171] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.469171] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.469171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.469728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.469728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.469728] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 1014.506923] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.507136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.507136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.507348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.507497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.520370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 1014.910016] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.910248] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.910371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.910658] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.910880] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.911083] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 103a5a03-bda9-49e6-be16-9268d486e5d0 not found, creating... [ 1014.911356] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.911516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.911632] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.912066] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.912244] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.912544] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.912703] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.912911] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.913163] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.913297] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.913434] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 103a5a03-bda9-49e6-be16-9268d486e5d0 is going to be created. [ 1014.934628] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.934940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.935137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.935457] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.935709] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.935968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.636629] env[65738]: INFO networking_nsxv3.common.synchronization [req-28c4dec5-4c0f-4fc0-aa22-80dc32457572 req-e5f92eb4-1370-482d-a271-f2fac2e8daa4 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 1015.636996] env[65738]: INFO networking_nsxv3.common.synchronization [req-28c4dec5-4c0f-4fc0-aa22-80dc32457572 req-e5f92eb4-1370-482d-a271-f2fac2e8daa4 service nova] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1015.636996] env[65738]: INFO networking_nsxv3.common.synchronization [req-28c4dec5-4c0f-4fc0-aa22-80dc32457572 req-e5f92eb4-1370-482d-a271-f2fac2e8daa4 service nova] Enqueued Resource ID: 103a5a03-bda9-49e6-be16-9268d486e5d0 with Priority: HIGHEST for action port [ 1015.637450] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_rules [ 1015.637578] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1015.637673] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a5a03-bda9-49e6-be16-9268d486e5d0 with Priority: HIGHEST for action port [ 1015.637942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.638156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.638295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.638418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.638500] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.639422] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.639523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.639697] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-103a5a03-bda9-49e6-be16-9268d486e5d0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.639796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.639852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.640012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.640094] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103a5a03-bda9-49e6-be16-9268d486e5d0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.735940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1015.736206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.141486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.141643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.141851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 103a5a03-bda9-49e6-be16-9268d486e5d0 with status ACTIVE [ 1016.142291] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.142291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.142438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.142795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.142795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.142941] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.143045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.143102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.143757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.143757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.143757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.143757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.143991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.143991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.143991] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 103a5a03-bda9-49e6-be16-9268d486e5d0 is going to be updated. [ 1016.191368] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.191456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.191496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.192069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.192069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.192196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-103a5a03-bda9-49e6-be16-9268d486e5d0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.301282] env[65738]: INFO networking_nsxv3.common.synchronization [req-27c06d41-0260-47f8-817a-f5b33fa8f114 req-a9a596eb-5d9f-4e1a-8f55-7b4f4794e05d tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1016.301851] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1016.302180] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.302386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.302386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.302636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.302800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.302895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.302951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.303189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.303189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.303300] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.530443] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 1016.530680] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 1016.530819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.531019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.531472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.531741] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.531920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.532193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.532263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.532358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.532480] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.593063] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.593063] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.593063] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.593374] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.593648] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.593815] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.593935] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.594305] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.594460] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.594670] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.594780] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.594889] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.594994] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.595115] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.595220] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.595352] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.613602] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.613757] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.613890] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.614075] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.614380] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-7f7a2696-d244-4587-b2f7-7b68ead73903 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.614548] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.614667] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.615008] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.615155] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f7a2696-d244-4587-b2f7-7b68ead73903',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.805215] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.805867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.805867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.805867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.805867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.806229] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.806229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.806229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.806384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.806384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.806463] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23565e98-53ea-4113-9741-85efc55da889 already deleted. [ 1016.806502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.035693] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.117153] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.117458] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.117593] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.117960] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.118235] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.118477] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 7f7a2696-d244-4587-b2f7-7b68ead73903 not found, creating... [ 1017.118746] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.118929] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.119108] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.119358] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.119498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.119789] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.119941] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.120068] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.120976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.120976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.120976] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 7f7a2696-d244-4587-b2f7-7b68ead73903 is going to be created. [ 1017.146890] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.147118] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.147248] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.147517] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.147745] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.147973] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.537931] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.863095] env[65738]: INFO networking_nsxv3.common.synchronization [req-27c06d41-0260-47f8-817a-f5b33fa8f114 req-1354c7ca-7d36-445f-80f8-4376ec91cfb0 service nova] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 1017.863095] env[65738]: INFO networking_nsxv3.common.synchronization [req-27c06d41-0260-47f8-817a-f5b33fa8f114 req-1354c7ca-7d36-445f-80f8-4376ec91cfb0 service nova] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1017.863095] env[65738]: INFO networking_nsxv3.common.synchronization [req-27c06d41-0260-47f8-817a-f5b33fa8f114 req-1354c7ca-7d36-445f-80f8-4376ec91cfb0 service nova] Enqueued Resource ID: 7f7a2696-d244-4587-b2f7-7b68ead73903 with Priority: HIGHEST for action port [ 1017.863461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_rules [ 1017.863461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1017.863461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f7a2696-d244-4587-b2f7-7b68ead73903 with Priority: HIGHEST for action port [ 1017.863715] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.863860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.863895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.864426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.864507] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.865626] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.865626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.865626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.865801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.865801] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.865887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.865920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.866063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.866141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.866931] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.867797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f7a2696-d244-4587-b2f7-7b68ead73903 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.867957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.868012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.868180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.868270] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f7a2696-d244-4587-b2f7-7b68ead73903',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.040743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.040743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.040942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.041106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.041200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.041771] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 1018.073875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.074062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.074145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.074365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.074510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.084035] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 1018.369282] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.371187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.371317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.371520] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f7a2696-d244-4587-b2f7-7b68ead73903 with status ACTIVE [ 1018.371723] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.371837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.371933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.372286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.372411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.372714] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.372714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.372937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.372937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.373214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.373286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.373389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.373446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.373567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.373658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.373759] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f7a2696-d244-4587-b2f7-7b68ead73903 is going to be updated. [ 1018.403161] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.403161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.403161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.403463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.403564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.403773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f7a2696-d244-4587-b2f7-7b68ead73903" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.876243] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.379298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.379533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.379533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.379685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.379776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.379880] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23565e98-53ea-4113-9741-85efc55da889 is going to be created. [ 1019.407688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.407839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.407912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.408155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.408319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.418789] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: UNINITIALIZED for 2s [ 1020.098656] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 1020.099021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.099281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.099515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.099719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.099840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.099906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.100083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.100160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.100252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.100372] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.603083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.603083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.603083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.603083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.603313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.603313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.603313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.603659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.603659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.603659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.603829] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.603887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.603936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.604062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.604197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.604282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.604333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.604465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.604532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.604608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.604815] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.106767] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1: rpc.has_security_group_logging(os_id): False [ 1021.129804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.129991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.130199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.130261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.130338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.130599] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.130677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.130725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.131358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.131358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.131358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.131358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.131358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.131646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.131646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.131768] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.131883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.131941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.132116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.132191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.132274] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 1021.203172] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.203395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.203395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.203605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.203750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.215762] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 1021.430175] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: SUCCESS [ 1021.430456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.430674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.430959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.431261] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.431438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.431561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.431784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.431911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.432042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.432182] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.934254] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.400597] env[65738]: INFO networking_nsxv3.common.synchronization [req-89011629-6906-4850-b596-e8e4f85580a7 req-7f8d9813-b485-44ad-ace7-400ebd66e04d tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1022.401650] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1022.401650] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.401841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.401841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.402292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.402292] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.402484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.402484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.402577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.403187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.403187] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.437838] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23565e98-53ea-4113-9741-85efc55da889: rpc.has_security_group_logging(os_id): False [ 1022.458049] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.458205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.458273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.458540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.458630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.458881] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.458993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.459065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.459217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.459294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.459382] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23565e98-53ea-4113-9741-85efc55da889 is going to be created. [ 1022.537115] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.537713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.537846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.538124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.538365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.557029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: IN_PROGRESS for 2s [ 1022.621187] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fddd03d-6104-4a01-80be-39b68c4b7667 req-ead1025a-3a86-4b24-ae03-44b9a054c205 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1022.621759] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1022.622102] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.622255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.622324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.622596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.622751] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.622847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.622900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.623807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.623909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.624034] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.905376] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.905503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.905576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.905817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.905923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.906149] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.906268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.906332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.906501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.906576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.906666] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 1022.945668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.945815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.945884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.946135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.946285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.951171] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.951362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.951485] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.951807] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.952137] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.952329] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.952480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.952721] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.952886] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.953110] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.953226] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.953336] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.953474] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.953595] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.953708] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.953868] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.956488] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1022.987316] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.988054] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.988054] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.988054] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.988315] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-fe40fdec-b63c-4e00-93b6-90e16f6d1313 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.988394] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.988516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.988826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.988965] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe40fdec-b63c-4e00-93b6-90e16f6d1313',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.126282] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.126461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.126575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.126889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.127061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.127373] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.127498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.127565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.127730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.127809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.127928] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 already deleted. [ 1023.127979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.247313] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 1023.247632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.491697] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.492049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.492099] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.492362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.492553] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.492723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port fe40fdec-b63c-4e00-93b6-90e16f6d1313 not found, creating... [ 1023.492988] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.493162] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.493288] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.493503] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.493642] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.494010] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.494148] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.494270] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.494471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.494605] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.494744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: fe40fdec-b63c-4e00-93b6-90e16f6d1313 is going to be created. [ 1023.521490] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.521792] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.521992] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.522275] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.522552] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.522792] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.030766] env[65738]: INFO networking_nsxv3.common.synchronization [req-6f420506-9dc9-4223-a0f3-aa3d33b720e9 req-ce6369be-8b53-4dd2-89fc-fc8afac8cb1b tempest-FloatingIPsAssociationTestJSON-1664428748 tempest-FloatingIPsAssociationTestJSON-1664428748-project-member] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 1024.031372] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGHEST for action security_group_members [ 1024.031678] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.031793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.031853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.032358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.032467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.032533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.032573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.032714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.032795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.032888] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.218565] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fddd03d-6104-4a01-80be-39b68c4b7667 req-befab0a5-d68f-4193-b270-060492b5ffe3 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1024.218758] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fddd03d-6104-4a01-80be-39b68c4b7667 req-befab0a5-d68f-4193-b270-060492b5ffe3 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1024.218878] env[65738]: INFO networking_nsxv3.common.synchronization [req-5fddd03d-6104-4a01-80be-39b68c4b7667 req-befab0a5-d68f-4193-b270-060492b5ffe3 service nova] Enqueued Resource ID: fe40fdec-b63c-4e00-93b6-90e16f6d1313 with Priority: HIGHEST for action port [ 1024.219346] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1024.219346] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1024.219588] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe40fdec-b63c-4e00-93b6-90e16f6d1313 with Priority: HIGHEST for action port [ 1024.220096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.220245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.220296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.220535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.220614] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.221484] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.221567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.221616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.222632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.222632] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.222632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.222632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.222632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.222632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.222632] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.223634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe40fdec-b63c-4e00-93b6-90e16f6d1313 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.223736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.223778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.223976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.224048] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe40fdec-b63c-4e00-93b6-90e16f6d1313',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.536369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.536721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.536721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.536817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.536908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.537138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.537241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.537303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.537456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.537544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.537635] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be updated. [ 1024.577708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.577934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.577979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.578205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.578636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.580408] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: SUCCESS [ 1024.580603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.591491] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: IN_PROGRESS for 2s [ 1024.725515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.725815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.727013] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe40fdec-b63c-4e00-93b6-90e16f6d1313 with status ACTIVE [ 1024.727218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.727340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.727409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.727627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.727715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.727891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.727984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.728059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.728218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.728304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.728491] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.728584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.728643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.728779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.728852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.728946] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe40fdec-b63c-4e00-93b6-90e16f6d1313 is going to be updated. [ 1024.729987] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.753997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.753997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.754128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.754264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.754399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.754564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe40fdec-b63c-4e00-93b6-90e16f6d1313" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.970498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1024.970687] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 1024.971025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.234083] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.736076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.736403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.736403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.736514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.736602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.736705] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be created. [ 1025.768560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.768850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.769359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.769359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.769359] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.782308] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: UNINITIALIZED for 2s [ 1025.835456] env[65738]: INFO networking_nsxv3.common.synchronization [req-0e6cbdc6-9423-41e8-bbb9-09c50df170f5 req-749125d1-f2f3-4ba4-8cb1-6041f8fffcad tempest-ImagesTestJSON-1824590836 tempest-ImagesTestJSON-1824590836-project-member] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1025.836035] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGHEST for action security_group_members [ 1025.836484] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.836617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.836715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.836953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.837158] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.837269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.837356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.838090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.838090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.838090] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.339979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.340232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.340363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.340571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.340665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.340883] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.340985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.341055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.341247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.341302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.341390] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be updated. [ 1026.383241] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.383479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.383611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.383920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.384142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.393799] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: IN_PROGRESS for 2s [ 1026.420952] env[65738]: INFO networking_nsxv3.common.synchronization [req-a987c97b-cb32-45da-bc8e-732d0d7f7a87 req-d761fd75-b0db-4898-bb23-e727d2e2ebfa tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 1026.421537] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGHEST for action security_group_members [ 1026.421843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.421963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.422042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.422242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.422413] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.422513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.422575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.422719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.422801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.422891] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.603129] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664447af-cc63-464d-83e7-bc563a3e53c3 in Status: SUCCESS [ 1026.603129] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 deletion is rescheduled due to dependency. [ 1026.603129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.924806] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.925135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.925201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.925537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.957367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.957710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.957839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.957926] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.958137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.958222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.958323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 is going to be updated. [ 1026.994423] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.994647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.994749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.995023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.995177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.005960] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: IN_PROGRESS for 2s [ 1027.261354] env[65738]: INFO networking_nsxv3.common.synchronization [req-b492ec9e-9b9b-4f66-845c-b29dfaec9b5c req-426d8bf6-c2ca-42e2-8930-e517369fbb76 tempest-ListImageFiltersTestJSON-158409542 tempest-ListImageFiltersTestJSON-158409542-project-member] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1027.261354] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1027.261354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.261354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.261354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.261597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.261965] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.261965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.261965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.262170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.262322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.262396] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.620404] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.620593] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.620714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.621019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.621334] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.621502] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.621595] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.621828] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.621974] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.622598] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.622726] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.622834] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.622945] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.623092] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.623211] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.623349] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.646588] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.646789] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.646889] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.647094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.647432] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-661fdf3d-6925-4090-aa6e-33ff2be30f3e taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.647606] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.647722] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.648059] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.648247] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661fdf3d-6925-4090-aa6e-33ff2be30f3e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.765652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.765811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.765884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.766172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.766265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.766480] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.766584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.766645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.766795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.766869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.766955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b already deleted. [ 1027.767042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.796413] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1027.796413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.796413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.796629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.796680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.796794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.796851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.796999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.797089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.797172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.797261] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.151339] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.151681] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.151744] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.151993] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.152161] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.152318] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 661fdf3d-6925-4090-aa6e-33ff2be30f3e not found, creating... [ 1028.152582] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.152736] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.152849] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.153184] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.153342] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.153634] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.153788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.153900] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.154123] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.154257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.154398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 661fdf3d-6925-4090-aa6e-33ff2be30f3e is going to be created. [ 1028.179298] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.179298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.179298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.179298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.179586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.179829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.300152] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.300375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.300375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.300610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.300790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.300902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.300961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.301146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.301260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.301369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.301530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.301626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.301680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.301832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.301974] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.302072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.302145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.302284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.302354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.302436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.302527] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.405789] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 in Status: SUCCESS [ 1028.405789] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 deletion is rescheduled due to dependency. [ 1028.405789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.806471] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1028.826249] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.827586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.827586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.827679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.827802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.828084] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.828243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.829384] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.829384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.829821] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.829959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.830077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.830272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.830409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.830530] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be created. [ 1028.887297] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.887528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.887649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.887878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.888023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.901555] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.901723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.901800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.902014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.902198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.918064] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1029.019889] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df92bfb8-0963-460c-8470-de80a6dd7728 in Status: SUCCESS [ 1029.020101] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 deletion is rescheduled due to dependency. [ 1029.020223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.374745] env[65738]: INFO networking_nsxv3.common.synchronization [req-b492ec9e-9b9b-4f66-845c-b29dfaec9b5c req-7b122770-bd67-4269-b788-da7d2e4d761d service nova] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_rules [ 1029.375035] env[65738]: INFO networking_nsxv3.common.synchronization [req-b492ec9e-9b9b-4f66-845c-b29dfaec9b5c req-7b122770-bd67-4269-b788-da7d2e4d761d service nova] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1029.375095] env[65738]: INFO networking_nsxv3.common.synchronization [req-b492ec9e-9b9b-4f66-845c-b29dfaec9b5c req-7b122770-bd67-4269-b788-da7d2e4d761d service nova] Enqueued Resource ID: 661fdf3d-6925-4090-aa6e-33ff2be30f3e with Priority: HIGHEST for action port [ 1029.375631] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_rules [ 1029.375769] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1029.375879] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661fdf3d-6925-4090-aa6e-33ff2be30f3e with Priority: HIGHEST for action port [ 1029.376151] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.376298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.376338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.376598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.376680] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.377803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.377803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.377803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.377936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.377997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.378104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.378167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.378333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.378402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.378472] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.379388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-661fdf3d-6925-4090-aa6e-33ff2be30f3e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.379610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.379707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.379845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.379957] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661fdf3d-6925-4090-aa6e-33ff2be30f3e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.390548] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.537870] env[65738]: INFO networking_nsxv3.common.synchronization [req-979ff895-0d44-48b8-b8b0-bf35fdde3087 req-fae61145-44cf-4b00-895d-ee8919e63988 tempest-ListImageFiltersTestJSON-158409542 tempest-ListImageFiltersTestJSON-158409542-project-member] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1029.538462] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1029.538775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.538879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.825134] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.825357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.825496] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.825743] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.826659] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.826659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.826659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.826659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.826659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.826889] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.827316] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.827316] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.827316] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.827521] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.827962] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.827962] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.850761] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.850761] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.850761] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.850761] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-667" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.850761] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-606976ca-04c5-40c2-ba18-8fbe3666ba5b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.850761] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.851378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.851378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.851378] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606976ca-04c5-40c2-ba18-8fbe3666ba5b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.881856] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.881988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.882243] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.883150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 661fdf3d-6925-4090-aa6e-33ff2be30f3e with status ACTIVE [ 1029.883370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.884522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.884623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.884851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.884959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.885197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.885328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.885410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.885685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.885685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.885910] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.885990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.886072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.886241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.886320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.886450] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 661fdf3d-6925-4090-aa6e-33ff2be30f3e is going to be updated. [ 1029.892867] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.914780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.914939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.915021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.915244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.915413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.915555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-661fdf3d-6925-4090-aa6e-33ff2be30f3e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.355039] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.355421] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.355557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.355834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.356061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.356270] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 606976ca-04c5-40c2-ba18-8fbe3666ba5b not found, creating... [ 1030.356586] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.356865] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.356961] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.357260] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.357497] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.357834] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.358051] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.358221] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.358601] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.358794] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.358979] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 606976ca-04c5-40c2-ba18-8fbe3666ba5b is going to be created. [ 1030.383154] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.383519] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.383565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.383883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.384176] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.384445] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.389088] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.397079] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1030.397201] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1030.891195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.891403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.891460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.891699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.891794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.891890] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be created. [ 1030.926288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.926288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.926288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.926585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.926797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.943487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: UNINITIALIZED for 2s [ 1030.945959] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1030.946296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.061662] env[65738]: INFO networking_nsxv3.common.synchronization [req-2dc1992c-a046-4a84-a8eb-020828dd648d req-f4583351-b44d-417d-88ba-3e1013c18ad1 tempest-ServerDiskConfigTestJSON-1652777112 tempest-ServerDiskConfigTestJSON-1652777112-project-member] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1031.062604] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGHEST for action security_group_members [ 1031.063079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.063330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.063495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.063840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.064148] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.064364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.064531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.064815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.065012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.065209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.106349] env[65738]: INFO networking_nsxv3.common.synchronization [req-979ff895-0d44-48b8-b8b0-bf35fdde3087 req-4bcccac4-2233-4b8e-bf74-c08fc2891f2f service nova] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_rules [ 1031.106472] env[65738]: INFO networking_nsxv3.common.synchronization [req-979ff895-0d44-48b8-b8b0-bf35fdde3087 req-4bcccac4-2233-4b8e-bf74-c08fc2891f2f service nova] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1031.108461] env[65738]: INFO networking_nsxv3.common.synchronization [req-979ff895-0d44-48b8-b8b0-bf35fdde3087 req-4bcccac4-2233-4b8e-bf74-c08fc2891f2f service nova] Enqueued Resource ID: 606976ca-04c5-40c2-ba18-8fbe3666ba5b with Priority: HIGHEST for action port [ 1031.108461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_rules [ 1031.108461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1031.108461] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606976ca-04c5-40c2-ba18-8fbe3666ba5b with Priority: HIGHEST for action port [ 1031.108461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.108461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.108461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.108461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.108461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-606976ca-04c5-40c2-ba18-8fbe3666ba5b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.108461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.109180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.109180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.109180] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606976ca-04c5-40c2-ba18-8fbe3666ba5b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.568098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.568478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.568478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.568584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.568682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.568884] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.568985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.569125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.569229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.569305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.569415] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be updated. [ 1031.587024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.587194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.587245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.587459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.601062] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1031.601981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.602972] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1031.610935] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 606976ca-04c5-40c2-ba18-8fbe3666ba5b with status ACTIVE [ 1031.611170] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.611337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.611470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.611628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.611710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.611887] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.611982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.612055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.612197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.612269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.612461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.612551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.612609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.612741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.612812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.612890] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 606976ca-04c5-40c2-ba18-8fbe3666ba5b is going to be updated. [ 1031.614559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.614668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.614733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.614881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.615008] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.633128] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: IN_PROGRESS for 2s [ 1031.637811] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.638021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.638021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.638219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.649606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.650306] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1031.650401] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.650477] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1031.652603] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.652753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.652798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.652981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.653110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.653256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-606976ca-04c5-40c2-ba18-8fbe3666ba5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.745410] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.745588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.745648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.745892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.747437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.747523] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1031.953769] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.954034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.954089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.954311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.954708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.955152] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1032.024669] env[65738]: INFO networking_nsxv3.common.synchronization [req-615a378b-353d-41cb-b17f-ddbf1cac1af8 req-d9bcf343-2c33-4566-8cfd-51649f67b3fc tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1032.025254] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1032.025565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.025686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.025754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.026041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.026197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.026569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.026569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.026682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.026682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.026754] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.047388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.047595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.047595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.047802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.048097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.048375] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1032.048471] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'728b373a-0a9d-4e10-b5ee-d0b6e2a75682', 'bbeb4a5d-7195-44c9-b3bc-982306062ac6', '2c141272-ba24-462d-b6ed-4f263864d60c', 'fb392433-b27c-4f33-a766-634f0f6c0dcb', '6b13c9f1-4035-4155-8f11-de49c18c0a4d', 'e974415d-6bf2-41ac-b8e6-2817575b8abd', '6db86bd4-3bec-4519-a16c-37ef219df535', 'fedc2c17-2f50-459d-88ff-941dd856cb4d', '7f6f7207-78fd-4f30-bb10-327e2c3450e8', '8fc0f4a9-1474-4292-821f-7f1aa18de95b', '1ce4c090-b8b5-42a5-846b-5d88bb5236ff', '98ae3e4c-e240-4cb3-a347-31d18a23b3fa', '9d59d770-c36e-45a8-b32b-e4620ef23233', '9e49fe7b-0238-41d4-921e-d91254c2761b', 'c7d9f780-2387-4768-9bde-778929c0c06d', '23565e98-53ea-4113-9741-85efc55da889', '3b02ac3e-b94a-42ba-b911-23fb0744001d', 'ace770a2-a23c-4a11-9747-3be56def5369', 'dd260df1-27ce-4a10-8b11-543f9fd7f080', 'a84a7a11-9309-4895-a6a4-e6d1f1dddb0b', '1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2', '664447af-cc63-464d-83e7-bc563a3e53c3', 'df92bfb8-0963-460c-8470-de80a6dd7728', '0a8cba6c-0779-4246-9afd-ecae574e4c9d', '5fb1ec78-dd9a-4648-b8b0-a049555e5a46', '5d9a650f-180d-4827-8a8a-cdff5aa50644', '8b62a35a-29b0-4826-a035-6eed21356980', 'ad710818-9f6b-4718-bff8-4836e8a61c3b', '194d1d45-daf3-4873-a0c4-a279f2704021', '13e04b13-1f3c-4f36-a68f-be19736a3742', '2b8b178e-30ff-4875-afce-3f12db8c8904', '93ac889c-a70d-42e4-9f0a-90c362835c16', '47750d4b-22bd-42e5-bf36-3cc17e08c0a0', 'ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05', 'f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee', '2b5f20e7-94a1-4514-adde-54a6960390c3', '21f8f014-13fa-4be1-97eb-834dadab33fd', '1cea2a24-1c24-47dc-87cf-758c1ad81488', '0abfdb06-6f7f-40a7-be5b-fa4298901330', '7e040984-bcc9-43b0-a9c8-bbd4511a7fc1', 'a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c', '5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b', '198f2d52-4200-42b2-be51-13b90ddae50d', '33ab54d8-f174-4187-9e64-2cd39cd90273', '60fa81d8-8f48-4912-b0e6-1cff6e6ccdff', '89618efc-1c71-4f3b-9cfc-d651fcf1fe99'} {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1032.048582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1032.071210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.071480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.071480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.071683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.071767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.071907] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1032.071972] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1032.072078] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1032.159098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.159098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.159098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.159098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.161023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.161023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1032.161023] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1032.161023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1032.161023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1032.161023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGH for action security_group_rules [ 1032.161023] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGH for action security_group_rules [ 1032.161600] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGH for action security_group_rules [ 1032.161832] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 1032.161832] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGH for action security_group_rules [ 1032.161832] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 1032.161832] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGH for action security_group_rules [ 1032.161955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.337215] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.337419] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.337541] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.337817] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.338726] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.338963] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.339145] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.339599] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.339764] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.340028] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.340147] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.340255] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.340381] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.340497] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.340605] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.340742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.366096] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.366096] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.366096] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.366096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.366384] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-abd03814-f467-4465-8528-2be8a3f0177c taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.370240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.370386] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.370818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.371586] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd03814-f467-4465-8528-2be8a3f0177c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.529235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.529583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.529690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.530064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.554546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.554784] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.555115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.555115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.555241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.555296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.555381] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1032.585622] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.586016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.586016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.586212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.586362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.597827] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1032.813967] env[65738]: INFO networking_nsxv3.common.synchronization [req-7d47330a-8f53-4987-bbc4-a105bb34eb4a req-08203e95-2269-4dfb-a934-00fec1723118 tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 1032.814377] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGHEST for action security_group_members [ 1032.814613] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 with Priority: HIGH for action security_group_rules [ 1032.814852] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c141272-ba24-462d-b6ed-4f263864d60c with Priority: HIGH for action security_group_rules [ 1032.815057] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGH for action security_group_rules [ 1032.815204] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGH for action security_group_rules [ 1032.815378] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b with Priority: HIGH for action security_group_rules [ 1032.815569] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 1032.815737] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace770a2-a23c-4a11-9747-3be56def5369 with Priority: HIGH for action security_group_rules [ 1032.815932] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 1032.816108] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e49fe7b-0238-41d4-921e-d91254c2761b with Priority: HIGH for action security_group_rules [ 1032.816239] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGH for action security_group_rules [ 1032.816353] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 with Priority: HIGH for action security_group_rules [ 1032.816463] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa with Priority: HIGH for action security_group_rules [ 1032.819306] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff with Priority: HIGH for action security_group_rules [ 1032.819478] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGH for action security_group_rules [ 1032.819578] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 with Priority: HIGH for action security_group_rules [ 1032.819748] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e974415d-6bf2-41ac-b8e6-2817575b8abd with Priority: HIGH for action security_group_rules [ 1032.819859] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc2c17-2f50-459d-88ff-941dd856cb4d with Priority: HIGH for action security_group_rules [ 1032.819948] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d with Priority: HIGH for action security_group_rules [ 1032.820059] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGH for action security_group_rules [ 1032.820154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 1032.820599] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.820739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.820803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.821268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.821366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.821486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.821701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.821812] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.822881] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.823031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.823088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.823223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.823298] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('728b373a-0a9d-4e10-b5ee-d0b6e2a75682',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.825079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c141272-ba24-462d-b6ed-4f263864d60c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.825079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.825079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.825079] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.825079] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c141272-ba24-462d-b6ed-4f263864d60c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.825701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.825701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.825701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.825887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.825887] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.827219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.827219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.827219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.827219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.827219] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.828321] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.828321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.828321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.829645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.829645] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84a7a11-9309-4895-a6a4-e6d1f1dddb0b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.831362] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.831568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.831709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.831981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.832082] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.833315] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ace770a2-a23c-4a11-9747-3be56def5369 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.833315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.833315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.833572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.833572] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ace770a2-a23c-4a11-9747-3be56def5369',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.834654] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.834798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.835534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.835534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.835534] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.837526] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e49fe7b-0238-41d4-921e-d91254c2761b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.837526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.837703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.837746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.837826] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e49fe7b-0238-41d4-921e-d91254c2761b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.839044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.839196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.839354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.839592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.839670] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.840848] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d59d770-c36e-45a8-b32b-e4620ef23233 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.840848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.841086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.841495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.841744] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d59d770-c36e-45a8-b32b-e4620ef23233',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.842897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.842897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.843083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.843178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.843537] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ae3e4c-e240-4cb3-a347-31d18a23b3fa',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.844156] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.845151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.845151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.845151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.845151] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ce4c090-b8b5-42a5-846b-5d88bb5236ff',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.846031] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.846031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.846031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.846031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.846241] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.847226] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.847341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.847407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.847567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.847711] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6f7207-78fd-4f30-bb10-327e2c3450e8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.848383] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e974415d-6bf2-41ac-b8e6-2817575b8abd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.848540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.848606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.848764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.849451] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e974415d-6bf2-41ac-b8e6-2817575b8abd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.850608] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fedc2c17-2f50-459d-88ff-941dd856cb4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.850736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.850798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.850962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.851039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fedc2c17-2f50-459d-88ff-941dd856cb4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.851977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.851977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.852097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.852202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.852261] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b13c9f1-4035-4155-8f11-de49c18c0a4d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.853151] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.853151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.853151] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.853323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.853359] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.854377] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.854377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.854377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.854563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.854563] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.858725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.858824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.858949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.859244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.877047] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.877211] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.877409] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.877777] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.878303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.878303] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port abd03814-f467-4465-8528-2be8a3f0177c not found, creating... [ 1032.879336] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.879564] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.879991] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.880207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.880446] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.880922] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.882133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.882133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.882133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.882133] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.882133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: abd03814-f467-4465-8528-2be8a3f0177c is going to be created. [ 1032.886607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.886823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.886928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.886995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.887839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.887839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.887839] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 is going to be updated. [ 1032.904449] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.904673] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.904947] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.905096] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.905308] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.905535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.920415] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.920415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.920415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.920646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.920760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.930979] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: IN_PROGRESS for 2s [ 1032.958650] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1032.958804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.958874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.959190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.959433] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.959584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.959683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.959771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.959910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.960107] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.357651] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.357795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.357853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.358099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.358267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.358366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.358428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.358577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.358672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.358758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.358846] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.361948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.362145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.362197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.362346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.362753] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.363210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.363293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.363458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.363546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.363636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.363727] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.372211] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.372386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.372477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.373014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.373486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.373602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.373676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.373841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.373912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.374020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.374198] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.379486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.379486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.379486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.379486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.379797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.379797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.379877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.381730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.381730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.381730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.381730] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.388023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.388023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.388023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.388168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.388339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.388395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.388433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.388576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.388669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.388716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.388795] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.401062] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.459906] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.459906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.459906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.459906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.461546] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.461894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.466047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.466047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.466047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466047] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.466047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.466047] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.467825] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.467955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.468743] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.468899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.469728] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.469844] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.472183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.472297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.474078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.474078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.474230] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.474593] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.474713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.475510] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.475956] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.476084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.476763] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.477218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.477326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.477952] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.478422] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.478517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.510902] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.511533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.511700] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e49fe7b-0238-41d4-921e-d91254c2761b is going to be deleted. [ 1033.512761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.513056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.543033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.543204] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ce4c090-b8b5-42a5-846b-5d88bb5236ff is going to be deleted. [ 1033.544053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.544278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.571682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.571856] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be deleted. [ 1033.572901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.573246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.600265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.600551] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 728b373a-0a9d-4e10-b5ee-d0b6e2a75682 is going to be deleted. [ 1033.601367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.601662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.603160] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.603289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.626210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.626346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.636090] env[65738]: INFO networking_nsxv3.common.synchronization [req-615a378b-353d-41cb-b17f-ddbf1cac1af8 req-a1730915-33e2-4774-82b2-7ee875b15572 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1033.636279] env[65738]: INFO networking_nsxv3.common.synchronization [req-615a378b-353d-41cb-b17f-ddbf1cac1af8 req-a1730915-33e2-4774-82b2-7ee875b15572 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1033.636418] env[65738]: INFO networking_nsxv3.common.synchronization [req-615a378b-353d-41cb-b17f-ddbf1cac1af8 req-a1730915-33e2-4774-82b2-7ee875b15572 service nova] Enqueued Resource ID: abd03814-f467-4465-8528-2be8a3f0177c with Priority: HIGHEST for action port [ 1033.637031] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1033.637183] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1033.637279] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd03814-f467-4465-8528-2be8a3f0177c with Priority: HIGHEST for action port [ 1033.638128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.638128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.638670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.638670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.638670] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd03814-f467-4465-8528-2be8a3f0177c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.639033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.639033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.639033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.639254] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd03814-f467-4465-8528-2be8a3f0177c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.645417] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 in Status: SUCCESS [ 1033.645605] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 deletion is rescheduled due to dependency. [ 1033.645723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.655789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.655978] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e974415d-6bf2-41ac-b8e6-2817575b8abd is going to be deleted. [ 1033.657242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.657490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.713519] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.713782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.714527] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.714643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.736146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.736327] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c141272-ba24-462d-b6ed-4f263864d60c is going to be deleted. [ 1033.737241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.737460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.813813] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.814039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.815093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.815232] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ace770a2-a23c-4a11-9747-3be56def5369 is going to be deleted. [ 1033.816084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.816301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.867407] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.867589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.867667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.867909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.868117] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.868259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.868306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.868472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.868569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.868678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.868847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.868952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.869029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.869206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.869428] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.869643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.869643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.869756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.870347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.870347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.870347] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.877725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.878440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.885392] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.887264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.887446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fedc2c17-2f50-459d-88ff-941dd856cb4d is going to be deleted. [ 1033.889109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.889339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.891106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.891296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.891296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.891777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.891884] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.891979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.892070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.892224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.892301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.892394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.892602] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.892693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.892757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.892910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.893067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.893172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.893237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.893356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.893426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.893513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.893599] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.896545] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.907316] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7d9f780-2387-4768-9bde-778929c0c06d: rpc.has_security_group_logging(os_id): False [ 1033.961394] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.961635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.970223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.970398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6f7207-78fd-4f30-bb10-327e2c3450e8 is going to be deleted. [ 1033.971722] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.973018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.973483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.985372] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.985569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.028271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.028402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.053607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.053813] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d59d770-c36e-45a8-b32b-e4620ef23233 is going to be deleted. [ 1034.054689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.054913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.054991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.055110] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be deleted. [ 1034.056022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.056204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.100071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.100071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be deleted. [ 1034.100915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.101136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.141687] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abd03814-f467-4465-8528-2be8a3f0177c with status ACTIVE [ 1034.141943] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.142086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.142154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.142368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.142455] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.142679] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.142851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.142851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.143090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.143179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.143366] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.143517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.143517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.143651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.143724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.143825] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abd03814-f467-4465-8528-2be8a3f0177c is going to be updated. [ 1034.163360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.163360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.171866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.171866] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ae3e4c-e240-4cb3-a347-31d18a23b3fa is going to be deleted. [ 1034.172959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.172959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.234022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.234158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.250920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.251208] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b13c9f1-4035-4155-8f11-de49c18c0a4d is going to be deleted. [ 1034.252260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.252505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.304653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.304854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84a7a11-9309-4895-a6a4-e6d1f1dddb0b is going to be deleted. [ 1034.306128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.306430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.306550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.307802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e49fe7b-0238-41d4-921e-d91254c2761b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.307866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.307995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.308095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.308402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.308662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.308931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd03814-f467-4465-8528-2be8a3f0177c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.309167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.309414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.309638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.309784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ce4c090-b8b5-42a5-846b-5d88bb5236ff" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.310345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.310547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.310613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.310689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-728b373a-0a9d-4e10-b5ee-d0b6e2a75682" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.310826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.310969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.311061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.311439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.311582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e974415d-6bf2-41ac-b8e6-2817575b8abd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.311873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.312247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.312247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.312247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c141272-ba24-462d-b6ed-4f263864d60c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.312392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.312392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.312485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.312852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ace770a2-a23c-4a11-9747-3be56def5369" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.312852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.312852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.358893] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.358893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.374360] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1034.387524] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.387703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.391336] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23565e98-53ea-4113-9741-85efc55da889: rpc.has_security_group_logging(os_id): False [ 1034.398804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.398956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.399184] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1034.400201] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fc0f4a9-1474-4292-821f-7f1aa18de95b: rpc.has_security_group_logging(os_id): False [ 1034.421192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.421488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.440817] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24ddde7-a754-4980-a39e-d99974676685 req-a2794fd2-0f3e-4a8a-9ab3-cb14c1f37215 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1034.441450] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1034.441837] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.442051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.442111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.442333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.442561] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.442680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.442795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.443014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.443109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.443231] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.447421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.447619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.462404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.462804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.462921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.463027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.463285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.463381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.463494] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d9f780-2387-4768-9bde-778929c0c06d is going to be updated. [ 1034.464758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.464984] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.465907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.466132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fedc2c17-2f50-459d-88ff-941dd856cb4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.466331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.466579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.466709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.467152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6f7207-78fd-4f30-bb10-327e2c3450e8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.468823] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.468961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.469160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.469427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.471536] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.471708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.477240] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.477375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.477442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.477666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.477749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.477855] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be updated. [ 1034.539072] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.539072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.556038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.556038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.584739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.587018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.587018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.587018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.587018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.587988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.588241] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1034.589538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.589992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.590224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.590450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.590716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.591075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.591290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.591544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ae3e4c-e240-4cb3-a347-31d18a23b3fa" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.592018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.592018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.644282] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.644629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.644629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.644725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.644877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.646582] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1034.646752] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d deletion is rescheduled due to dependency. [ 1034.646847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.647413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.647614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.647835] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.647952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.648027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.648191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.648274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.648366] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.662340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.662846] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.663012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.663012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.663317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.663403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.663533] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23565e98-53ea-4113-9741-85efc55da889 is going to be updated. [ 1034.665989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.666596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.670470] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1034.711142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.711279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.741017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.741323] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.741449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.741622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.741858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.741952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.742309] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.742444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.742531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.742706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.742785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.743108] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.743202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.743249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.743396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.743474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.743593] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1034.744760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.744938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.745036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.745166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84a7a11-9309-4895-a6a4-e6d1f1dddb0b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.746158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.746410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b13c9f1-4035-4155-8f11-de49c18c0a4d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.746544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.746692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.746776] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.747629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.747790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.823692] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.824189] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.824427] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.824794] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.825187] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.825440] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.825637] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.825944] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.826180] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.826488] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.826670] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.826860] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.827060] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.827261] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.827445] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.827656] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.830270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.830637] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.830772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.830894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.831147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.831265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.831576] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b is going to be updated. [ 1034.834113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.836238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.836238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.836238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.836238] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.836878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.837059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.837113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.838321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.838498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.838622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.839811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d59d770-c36e-45a8-b32b-e4620ef23233" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.870398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1034.875008] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: IN_PROGRESS for 2s [ 1034.886093] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.886330] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.059 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.886423] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.886622] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.887011] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.887201] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.887322] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.887665] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.887804] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37ad0ee7-0fcc-438c-9414-a3370b0f4f6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.912019] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.912206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.912206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.912425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.912585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.946201] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.948652] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 in Status: SUCCESS [ 1034.949379] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 deletion is rescheduled due to dependency. [ 1034.949379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.980252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: IN_PROGRESS for 2s [ 1035.020116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.020379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.020379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.020545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.020694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.022871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.023071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.023071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.023266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.023406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.055749] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: IN_PROGRESS for 2s [ 1035.066447] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1035.152182] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.251533] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.251718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.391459] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.391459] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.391459] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.391729] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.391856] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.392044] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b not found, creating... [ 1035.392327] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.392513] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.392627] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.392846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.392980] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.393284] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.393486] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.393547] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.393801] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.393995] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.394169] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b is going to be created. [ 1035.425167] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.425381] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.425456] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.425768] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.426011] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.426266] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.448507] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.655947] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.953043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.953043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.953043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.953043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.953043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.953043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1035.988067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.988372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.988372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.988645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.988739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.006518] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1036.138085] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24ddde7-a754-4980-a39e-d99974676685 req-34fd743a-2403-49a8-bd75-2350351ac760 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1036.138325] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24ddde7-a754-4980-a39e-d99974676685 req-34fd743a-2403-49a8-bd75-2350351ac760 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1036.138505] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24ddde7-a754-4980-a39e-d99974676685 req-34fd743a-2403-49a8-bd75-2350351ac760 service nova] Enqueued Resource ID: 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b with Priority: HIGHEST for action port [ 1036.139102] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1036.139259] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1036.139397] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b with Priority: HIGHEST for action port [ 1036.139732] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.139870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.140098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.140206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.140425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.140572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.140639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.140868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.140952] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37ad0ee7-0fcc-438c-9414-a3370b0f4f6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.157849] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.158027] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.158102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.158308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.158612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.158612] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1036.206986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.206986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.206986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.206986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.206986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.216957] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1036.643075] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b with status ACTIVE [ 1036.643194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.643305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.643373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.643611] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.643705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.643918] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.644032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.644073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.644232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.644306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.644490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.644584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.644647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.644782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.644875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.644930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37ad0ee7-0fcc-438c-9414-a3370b0f4f6b is going to be updated. [ 1036.666826] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.667187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.667187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.667267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.667372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.667538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37ad0ee7-0fcc-438c-9414-a3370b0f4f6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.707331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1036.707569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.707767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.707999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.708231] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.708353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.708435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.708866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.708866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.708866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.708866] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.710019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.710105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.710773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.710773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.710773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.710773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.710773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.711064] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.896499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: SUCCESS [ 1036.896499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.896499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1036.896499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.995439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: SUCCESS [ 1036.995439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.069573] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: SUCCESS [ 1037.070281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.081625] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1037.081625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.081625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.081625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.081625] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.213328] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.214039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.214039] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.437520] env[65738]: INFO networking_nsxv3.common.synchronization [req-7c837682-805b-4d7e-b587-7091a9d41fd5 req-a8880d4d-6f25-4b6e-a39f-b97c5dc4c442 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1037.438175] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1037.438894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.439040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.439110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.439305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.439464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.439585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.439654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.439793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.439874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.439968] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.582985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.583152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.718482] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.942279] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.942440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.942516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.942821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.943553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.943779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.943949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.944028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.944167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.944267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.944369] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1037.987665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.988969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.988969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.988969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.989895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.002276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1038.019199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1038.019554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.019794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.020583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.020839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.021029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.021183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.021296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.021375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.021505] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.220548] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.220759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.220759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.221071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.221234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.221389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be updated. [ 1038.230969] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 4s [ 1038.289565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.289826] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.289931] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.290213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.290423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.300771] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1038.527122] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.031683] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.534982] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.535267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.535267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.535520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.535648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536751] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1039.571096] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.571257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.571329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.571857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.572043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.582734] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1040.014655] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1040.014925] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 deletion is rescheduled due to dependency. [ 1040.015212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.240951] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1040.241315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.241315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.241472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.241709] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.241804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.241877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.242048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.242135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.242222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.242317] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.322814] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1040.323166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.323434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.323698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.324059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.324240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.324345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.324561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.324685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.324822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.325043] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.325197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.325295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.325480] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.325671] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.325808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.325900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.326094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.326218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.326344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.326483] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.744944] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.829617] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2041f9c1-bd84-43e4-91ac-f0b92547a55b: rpc.has_security_group_logging(os_id): False [ 1040.866555] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.866555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.866555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.868218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.868218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.868629] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.868629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.868747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.868881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.868987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.869350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.869527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.869664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.869921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.870014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.870172] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be created. [ 1040.989644] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.989942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.990022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.990321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.990558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.008288] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1041.251567] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b02ac3e-b94a-42ba-b911-23fb0744001d: rpc.has_security_group_logging(os_id): False [ 1041.283446] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.283446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.283446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.283653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.283731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.283997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.284130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.284197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.284354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.284432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.284521] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be created. [ 1041.373590] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.373590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.373783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.373863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.374063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.401159] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1041.596993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1041.597254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.597432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.597660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.597861] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.597979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.598060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.598376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.598464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.598596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.598656] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.734912] env[65738]: INFO networking_nsxv3.common.synchronization [req-3dc7b1c1-b422-46f9-bacf-7718c20674ad req-b7c4956c-ee5b-4494-bb25-839c5587b2c2 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 1041.735546] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGHEST for action security_group_members [ 1041.736668] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.736812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.736890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.737332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.737525] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.737641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.737706] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.738117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.738117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.738205] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.101854] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.102919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.102919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.103351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.103351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.103351] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.103351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.103518] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.104089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.104089] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.104089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.104089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.104291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.104291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.104291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.105164] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.242170] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.242396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.242457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.243049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.243496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.245505] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.245505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.245505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.245505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.245505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.245505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d9f780-2387-4768-9bde-778929c0c06d is going to be updated. [ 1042.304022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.304510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.304510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.304650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.304723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.319427] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: IN_PROGRESS for 2s [ 1042.607994] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1042.627344] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.628167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.628293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.628735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.628883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.629506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.629675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.629824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.629953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.630087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.630332] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.630462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.630548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.630717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.630823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.631066] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.631197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.631293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.631462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.631564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.631701] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1042.716606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.717157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.717285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.735010] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1043.022037] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1043.022037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.022364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.022595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.022737] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.418493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1043.419144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.502463] env[65738]: INFO networking_nsxv3.common.synchronization [None req-885a3df3-bbb4-42d7-bb18-2bafd980d9fb None None] Enqueued Resource ID: f9e623f1-b405-44bd-b15b-cd6c87cb1403 with Priority: HIGHEST for action port [ 1043.503104] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e623f1-b405-44bd-b15b-cd6c87cb1403 with Priority: HIGHEST for action port [ 1043.503414] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9e623f1-b405-44bd-b15b-cd6c87cb1403 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.503603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9e623f1-b405-44bd-b15b-cd6c87cb1403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.503603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9e623f1-b405-44bd-b15b-cd6c87cb1403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.503878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9e623f1-b405-44bd-b15b-cd6c87cb1403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.503977] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e623f1-b405-44bd-b15b-cd6c87cb1403',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.527392] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.527731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.527731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.527973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.528601] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.528601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.528601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.528789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.528862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.529110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.529110] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.010088] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9e623f1-b405-44bd-b15b-cd6c87cb1403 [ 1044.010440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.010621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.010701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.010976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.011101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.011227] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9e623f1-b405-44bd-b15b-cd6c87cb1403 already deleted. [ 1044.011323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9e623f1-b405-44bd-b15b-cd6c87cb1403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.031728] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.031998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.031998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.032250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.032425] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.032527] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.032627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.032803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.032958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.033078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.033237] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.033329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.033384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.033525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.033700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.033841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.033841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.033996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.034107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.034192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.034287] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.333436] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d9f780-2387-4768-9bde-778929c0c06d in Status: SUCCESS [ 1044.333699] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d9f780-2387-4768-9bde-778929c0c06d deletion is rescheduled due to dependency. [ 1044.333869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.538396] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2041f9c1-bd84-43e4-91ac-f0b92547a55b: rpc.has_security_group_logging(os_id): False [ 1044.561306] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.561306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.561306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.561484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.563337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.563337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.563337] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.563337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.564170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.564170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.564170] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be updated. [ 1044.628816] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.629839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.629839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.629839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.630388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.663248] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1044.754400] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1044.754400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.700441] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1046.700934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.741016] env[65738]: INFO networking_nsxv3.common.synchronization [None req-44cfeee7-8d82-4fa5-b74c-523abf3b2504 None None] Enqueued Resource ID: b8314e6a-0da5-4104-9758-166dc217cdf1 with Priority: HIGHEST for action port [ 1046.741016] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8314e6a-0da5-4104-9758-166dc217cdf1 with Priority: HIGHEST for action port [ 1046.741016] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8314e6a-0da5-4104-9758-166dc217cdf1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.741788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8314e6a-0da5-4104-9758-166dc217cdf1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.741903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8314e6a-0da5-4104-9758-166dc217cdf1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.742224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8314e6a-0da5-4104-9758-166dc217cdf1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.742310] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8314e6a-0da5-4104-9758-166dc217cdf1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.894279] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a0438965-be26-43b3-a65c-196ab8bba333 None None] Enqueued Resource ID: b4c42c9e-e1ad-4d5b-941c-803bd2533f42 with Priority: HIGHEST for action port [ 1046.898808] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c42c9e-e1ad-4d5b-941c-803bd2533f42 with Priority: HIGHEST for action port [ 1046.900073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c42c9e-e1ad-4d5b-941c-803bd2533f42 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.900290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c42c9e-e1ad-4d5b-941c-803bd2533f42" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.900290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c42c9e-e1ad-4d5b-941c-803bd2533f42" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.902044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c42c9e-e1ad-4d5b-941c-803bd2533f42" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.902044] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c42c9e-e1ad-4d5b-941c-803bd2533f42',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.246404] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8314e6a-0da5-4104-9758-166dc217cdf1 [ 1047.246730] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.246862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.246968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.247202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.247297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.247398] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8314e6a-0da5-4104-9758-166dc217cdf1 already deleted. [ 1047.247490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8314e6a-0da5-4104-9758-166dc217cdf1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.404742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4c42c9e-e1ad-4d5b-941c-803bd2533f42 [ 1047.405333] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.405333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.405333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.405497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.405530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.405674] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4c42c9e-e1ad-4d5b-941c-803bd2533f42 already deleted. [ 1047.405810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c42c9e-e1ad-4d5b-941c-803bd2533f42" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.701085] env[65738]: INFO networking_nsxv3.common.synchronization [req-104ca6fb-b180-4ca5-8cd5-283b84ef1aa0 req-52182854-2d78-4e9a-8723-1837ae4d3481 tempest-ServersTestJSON-1562028512 tempest-ServersTestJSON-1562028512-project-member] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 1047.701085] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGHEST for action security_group_members [ 1047.701085] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.705556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.705556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.705556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.705556] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.705918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.705918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.705918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.705918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.706066] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.209131] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.209642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.209812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.210124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.238274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.238429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.238543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.238600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.238902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.239040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.239129] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 is going to be updated. [ 1048.277603] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.277823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.278031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.278181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.291491] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: IN_PROGRESS for 2s [ 1048.739372] env[65738]: INFO networking_nsxv3.common.synchronization [req-9e23c9c5-291a-4094-8b2f-51441a9d58db req-e51e77d5-45e2-47da-ba66-a850c23dd136 tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1048.739973] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1048.740306] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.740416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.740485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.740688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.740843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.740943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.740998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.742443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.742443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.742443] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.165238] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.165238] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.165238] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.165506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.165741] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.166559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.166559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.166559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.166559] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.166987] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.166987] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.166987] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.167180] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.167180] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.167937] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.167937] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.192556] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.192709] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.193122] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.193122] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-932" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.193356] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-3c969295-a1dd-4a47-ad8e-423515034bb4 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.193991] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.193991] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.194196] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.194247] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c969295-a1dd-4a47-ad8e-423515034bb4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.244847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.245115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.245115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.245324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.245392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.245617] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.245755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.245818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.245980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.246070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.246179] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be deleted. [ 1049.295836] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.295836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.295836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.295836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.295836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.295836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.698159] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.698159] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.698159] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.698765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.698765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.698765] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 3c969295-a1dd-4a47-ad8e-423515034bb4 not found, creating... [ 1049.699023] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.699308] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.699489] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.699695] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.699835] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.700165] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.700310] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.700440] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.700692] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.700830] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.700971] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 3c969295-a1dd-4a47-ad8e-423515034bb4 is going to be created. [ 1049.726035] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.726265] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.726338] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.726615] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.726847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.727087] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.286994] env[65738]: INFO networking_nsxv3.common.synchronization [None req-052440b5-4081-450d-8180-95b271b7d4e7 None None] Enqueued Resource ID: 991bc1cf-4ee3-46f7-9aae-6d844ccb2705 with Priority: HIGHEST for action port [ 1050.286994] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 991bc1cf-4ee3-46f7-9aae-6d844ccb2705 with Priority: HIGHEST for action port [ 1050.286994] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-991bc1cf-4ee3-46f7-9aae-6d844ccb2705 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.286994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-991bc1cf-4ee3-46f7-9aae-6d844ccb2705" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.286994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-991bc1cf-4ee3-46f7-9aae-6d844ccb2705" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.287533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-991bc1cf-4ee3-46f7-9aae-6d844ccb2705" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.287711] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('991bc1cf-4ee3-46f7-9aae-6d844ccb2705',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.304834] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 in Status: SUCCESS [ 1050.304834] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 deletion is rescheduled due to dependency. [ 1050.304834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.480150] env[65738]: INFO networking_nsxv3.common.synchronization [req-9e23c9c5-291a-4094-8b2f-51441a9d58db req-ed9375fb-0ccc-4581-aaf3-197c953d8f3e service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 1050.480344] env[65738]: INFO networking_nsxv3.common.synchronization [req-9e23c9c5-291a-4094-8b2f-51441a9d58db req-ed9375fb-0ccc-4581-aaf3-197c953d8f3e service nova] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1050.480488] env[65738]: INFO networking_nsxv3.common.synchronization [req-9e23c9c5-291a-4094-8b2f-51441a9d58db req-ed9375fb-0ccc-4581-aaf3-197c953d8f3e service nova] Enqueued Resource ID: 3c969295-a1dd-4a47-ad8e-423515034bb4 with Priority: HIGHEST for action port [ 1050.481890] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_rules [ 1050.481890] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1050.481890] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c969295-a1dd-4a47-ad8e-423515034bb4 with Priority: HIGHEST for action port [ 1050.482217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.482375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.482460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.482693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.482801] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.483741] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.483896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.483983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.484203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.484415] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.484545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.484632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.484807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.484924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.485056] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.487253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c969295-a1dd-4a47-ad8e-423515034bb4 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.487253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.487253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.487253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.487253] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c969295-a1dd-4a47-ad8e-423515034bb4',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.796109] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 991bc1cf-4ee3-46f7-9aae-6d844ccb2705 [ 1050.796353] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.796488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.796560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.796780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.796867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.796962] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:991bc1cf-4ee3-46f7-9aae-6d844ccb2705 already deleted. [ 1050.797058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-991bc1cf-4ee3-46f7-9aae-6d844ccb2705" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.989700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.989904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.990070] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.990983] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c969295-a1dd-4a47-ad8e-423515034bb4 with status ACTIVE [ 1050.991252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.991415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.991525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.991783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.991949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.992597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.992597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.992597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.992597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.992597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.993152] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.993152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.993152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.993152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.993305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.993305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c969295-a1dd-4a47-ad8e-423515034bb4 is going to be updated. [ 1051.018494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.018695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.018772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.019138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.019138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.019292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c969295-a1dd-4a47-ad8e-423515034bb4" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.336236] env[65738]: INFO networking_nsxv3.common.synchronization [None req-9af2e40d-13dc-47bd-bdf3-ab43ead4dcf2 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1051.336879] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1051.337083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.337353] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.337505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.338345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.338489] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.419938] env[65738]: INFO networking_nsxv3.common.synchronization [None req-92f272a3-2a43-4455-8ccf-f38bc790b5d4 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1051.420560] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1051.420763] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.420868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.495957] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.864165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.864165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.864165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.864165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.864165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.864617] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 already deleted. [ 1051.864617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.864617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.864735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.864735] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.998487] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.998731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.998804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.999085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.999178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.999311] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 1052.026348] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.026563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.026563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.026777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.026942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.040746] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: UNINITIALIZED for 2s [ 1052.125268] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c024ba01-5c86-43df-a211-3f97d14a3793 None None] Enqueued Resource ID: b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d with Priority: HIGHEST for action port [ 1052.126105] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d with Priority: HIGHEST for action port [ 1052.126364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.126488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.126549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.126915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.126915] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.389675] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.390063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.390063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.390171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.390266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.390364] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 already deleted. [ 1052.390445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.630584] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d [ 1052.631938] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.631938] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d already deleted. [ 1052.631938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c917c2-8ed7-4ee6-a3c2-4c2f37efac1d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.151884] env[65738]: INFO networking_nsxv3.common.synchronization [req-23c958c0-132d-445b-a07a-48958ab7fc90 req-bb09b22c-2c05-44cc-b239-dceb319c490c tempest-ImagesOneServerTestJSON-946912510 tempest-ImagesOneServerTestJSON-946912510-project-member] Enqueued Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1053.152577] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1053.152871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.152989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.154368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.154981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.154981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.155897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.155897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.155897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.155897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.155897] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.662274] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.662622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.662622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.663029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.663029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.663398] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.663398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.663531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.663596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.663684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.663776] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d already deleted. [ 1053.663902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.666767] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-304 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.667014] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-304" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.667217] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-304" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.667638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-304" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.667978] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.668225] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.668455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.668760] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.668955] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.669228] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.669401] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.669585] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.669756] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.669890] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.670045] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.670199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.693400] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.693805] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.694046] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.694264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-304" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.694691] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-e2ba0d04-ea9f-481b-b61b-084561a5e583 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.694945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.695166] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.695538] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.695699] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ba0d04-ea9f-481b-b61b-084561a5e583',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.053765] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1054.054141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.054362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.054607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.054811] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.054918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.054983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.055156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.055233] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.055306] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.055391] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.156334] env[65738]: INFO networking_nsxv3.common.synchronization [req-2ca45dd9-d3d7-43b3-b60d-94c2482ca81b req-0fb1f2f9-59a8-4fd7-9e1b-6b8003d65f72 tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 1054.156871] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 1054.157551] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.157780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.157780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.158036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.158233] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.158358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.158446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.158632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.158736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.158859] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.198395] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.198671] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.198817] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.201939] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port e2ba0d04-ea9f-481b-b61b-084561a5e583 not found, creating... [ 1054.201939] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.201939] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.201939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.202677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.202677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.202677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.202677] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: e2ba0d04-ea9f-481b-b61b-084561a5e583 is going to be created. [ 1054.224882] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.225565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.225565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.225565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.225810] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.226122] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.557530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.557729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.557807] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.558086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.558221] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.558324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.558390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.558544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.558664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.558725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.558852] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.558955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.559046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.560021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.560021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.560021] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.662566] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.858965] env[65738]: INFO networking_nsxv3.common.synchronization [None req-a2e54fc8-b274-45ad-8622-aa4d477d2405 None None] Enqueued Resource ID: 9fde7b95-15a3-465a-84b2-1e1b0d49caed with Priority: HIGHEST for action port [ 1054.859886] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fde7b95-15a3-465a-84b2-1e1b0d49caed with Priority: HIGHEST for action port [ 1054.859886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fde7b95-15a3-465a-84b2-1e1b0d49caed taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.859886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fde7b95-15a3-465a-84b2-1e1b0d49caed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.859886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fde7b95-15a3-465a-84b2-1e1b0d49caed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.860268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fde7b95-15a3-465a-84b2-1e1b0d49caed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.860268] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fde7b95-15a3-465a-84b2-1e1b0d49caed',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.911482] env[65738]: INFO networking_nsxv3.common.synchronization [req-0486257c-21aa-479b-aac3-51839ffee187 req-eaf2dd39-1b31-4c39-b631-dc7e498b36fa tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 1054.911482] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGHEST for action security_group_members [ 1054.911803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.911937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.912024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.912368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.912429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.912543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.912602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.912774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.912864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.912964] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.034767] env[65738]: INFO networking_nsxv3.common.synchronization [req-23c958c0-132d-445b-a07a-48958ab7fc90 req-05f60eb0-4f40-4916-95ca-abefe3a08874 service nova] Enqueued Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_rules [ 1055.035010] env[65738]: INFO networking_nsxv3.common.synchronization [req-23c958c0-132d-445b-a07a-48958ab7fc90 req-05f60eb0-4f40-4916-95ca-abefe3a08874 service nova] Enqueued Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1055.035131] env[65738]: INFO networking_nsxv3.common.synchronization [req-23c958c0-132d-445b-a07a-48958ab7fc90 req-05f60eb0-4f40-4916-95ca-abefe3a08874 service nova] Enqueued Resource ID: e2ba0d04-ea9f-481b-b61b-084561a5e583 with Priority: HIGHEST for action port [ 1055.035707] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_rules [ 1055.035856] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1055.035969] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ba0d04-ea9f-481b-b61b-084561a5e583 with Priority: HIGHEST for action port [ 1055.036269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.036396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.036462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.036895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.036895] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.037783] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.038217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.038281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.038468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.038623] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.038754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.038828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.039044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.039215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.039215] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.044931] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2ba0d04-ea9f-481b-b61b-084561a5e583 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.045036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.045126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.045364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.045511] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ba0d04-ea9f-481b-b61b-084561a5e583',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.062927] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb392433-b27c-4f33-a766-634f0f6c0dcb: rpc.has_security_group_logging(os_id): False [ 1055.086517] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.086790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.087020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.087112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.087310] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.087454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.087517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.088025] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.088025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.088260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.088260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.088727] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.089746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.089746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.089746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.089746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.089746] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be created. [ 1055.160090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.160261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.160816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.160816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.160978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.166820] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.178724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1055.364902] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fde7b95-15a3-465a-84b2-1e1b0d49caed [ 1055.365750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.365750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.365750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.365750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.365750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.365750] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fde7b95-15a3-465a-84b2-1e1b0d49caed already deleted. [ 1055.366255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fde7b95-15a3-465a-84b2-1e1b0d49caed" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.416071] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.417486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.417486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.417486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.443544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.443965] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.444153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.444270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.444583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.444733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.444876] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 is going to be updated. [ 1055.478453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.478672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.478776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.479071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.479285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.490561] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: IN_PROGRESS for 2s [ 1055.548861] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.548861] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.548861] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.548861] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2ba0d04-ea9f-481b-b61b-084561a5e583 with status ACTIVE [ 1055.549556] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.549556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.549556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.549556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.549729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.549806] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.549958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.550042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.551140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.551304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.551666] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.551839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.551972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.552346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.552744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.552744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2ba0d04-ea9f-481b-b61b-084561a5e583 is going to be updated. [ 1055.586601] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.586601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.586601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.586601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.586601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.587029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2ba0d04-ea9f-481b-b61b-084561a5e583" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.670429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.670959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.670959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.670959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.671198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.671198] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be updated. [ 1055.721904] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.721904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.721904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.722272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.722368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.734851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 1056.055159] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.560588] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.560588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.560588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.560588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.560588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.560588] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d is going to be created. [ 1056.585446] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.585528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.585601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.585983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.586171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.600708] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: UNINITIALIZED for 2s [ 1056.719450] env[65738]: INFO networking_nsxv3.common.synchronization [req-0cc037da-f854-40bc-8cb1-19471cca1e53 req-a2cec24b-8d38-4873-8d10-2bfc05702eaa tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1056.719450] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1056.719450] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.719450] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.719450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.720105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.720105] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.098024] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.098024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.098024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.098209] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.098395] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.098544] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.098653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.100637] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.100637] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.100637] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.100637] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.100637] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.100637] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.100637] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.100637] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.100637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.123818] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.123951] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.124112] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.124289] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.124638] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.124834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.124945] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.125266] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.125422] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4868d5-ad32-43bc-aef4-07add9d4cf5b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.192757] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1057.193066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.222275] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.222513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.222513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.222714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.222803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.223564] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.223564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.223564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.223564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.223564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.223564] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be deleted. [ 1057.270242] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.270391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.270460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.270771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.270936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.271065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.504406] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 in Status: SUCCESS [ 1057.504607] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 deletion is rescheduled due to dependency. [ 1057.505011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.627514] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.627817] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.628045] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.628457] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.628684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.628891] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 4e4868d5-ad32-43bc-aef4-07add9d4cf5b not found, creating... [ 1057.629230] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.629437] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.629584] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.629826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.629986] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.630321] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.630528] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.630683] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.630964] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.631116] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.631275] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b is going to be created. [ 1057.655180] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.655475] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.655656] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.656053] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.656356] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.656660] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.747669] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 1057.747941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.353074] env[65738]: INFO networking_nsxv3.common.synchronization [req-0cc037da-f854-40bc-8cb1-19471cca1e53 req-74373107-0c93-4e58-b967-a2b3053e636e service nova] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_rules [ 1058.353264] env[65738]: INFO networking_nsxv3.common.synchronization [req-0cc037da-f854-40bc-8cb1-19471cca1e53 req-74373107-0c93-4e58-b967-a2b3053e636e service nova] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1058.353412] env[65738]: INFO networking_nsxv3.common.synchronization [req-0cc037da-f854-40bc-8cb1-19471cca1e53 req-74373107-0c93-4e58-b967-a2b3053e636e service nova] Enqueued Resource ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with Priority: HIGHEST for action port [ 1058.353962] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_rules [ 1058.354107] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1058.354203] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with Priority: HIGHEST for action port [ 1058.357788] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.357929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.358014] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.360184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.360184] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.360544] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.360672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.360672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.361927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.361927] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.362134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.362134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.362234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.362310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.362381] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.363251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.363465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.363465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.363577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.363652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4868d5-ad32-43bc-aef4-07add9d4cf5b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.612133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: SUCCESS [ 1058.612454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.613021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.613265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.613479] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.613602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.613691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.613876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.613954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.614056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.614152] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.866104] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.866655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.866655] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.868498] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with status ACTIVE [ 1058.869747] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.869876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.869942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.870177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.870256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.870456] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.870549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.870615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.870889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.870889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.871051] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.871141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.871198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.871419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.871505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.871587] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b is going to be updated. [ 1058.895819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.896070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.896123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.896389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.896546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896704] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.116938] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.117115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.117253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.117399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.117566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.117666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.117730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.117877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.117962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.118060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.118204] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.118296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.118356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.118493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.118655] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.118744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.118795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.118912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.118982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.119073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.119164] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.214178] env[65738]: INFO networking_nsxv3.common.synchronization [req-8856e103-1c22-4ae9-bb4f-11f44fcc0a5f req-e237d997-abd8-481d-b145-72fcc96db140 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1059.214941] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1059.216232] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.216361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.216434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.216641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.216802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.216901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.216963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.217145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.217232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.217328] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.373739] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.559530] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.559713] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.559837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.560119] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.560370] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.561024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.561115] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.561371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.561529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.561778] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.561847] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.561952] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.562077] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.562189] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.562296] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.562443] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.584606] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.584766] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.584824] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.585023] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.585347] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.585523] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.585641] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.585968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.586149] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a317fa9-760c-4ba8-b3c1-0e44bd930b96',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.621202] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for beb1b5dc-c27a-4190-9267-6cb5279fa23d: rpc.has_security_group_logging(os_id): False [ 1059.641977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.642185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.642242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.642643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.642750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.643011] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.643475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.643475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.643602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.643674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.643977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.644156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.644261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.644422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.644501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.644707] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.644843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.644885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.644991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.645078] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.645165] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d is going to be created. [ 1059.702116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.702251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.702301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.702600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.702811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.714557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: IN_PROGRESS for 2s [ 1059.719980] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.879978] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.880593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.880805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.881228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.881511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.881724] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be created. [ 1059.905412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.905563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.906077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.906077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.906218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.917099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: UNINITIALIZED for 2s [ 1060.088910] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.089324] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.089485] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.089775] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.089931] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.090107] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 not found, creating... [ 1060.090368] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.090529] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.090645] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.090866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.091007] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.091349] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.091518] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.091638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.091867] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.091998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.092151] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 is going to be created. [ 1060.112398] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.112677] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.112813] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.113183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.113495] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.113765] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.222655] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.725120] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.725319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.725390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.725610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.725699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.725798] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1060.756456] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.756456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.756456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.758246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.758246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.767245] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1060.813711] env[65738]: INFO networking_nsxv3.common.synchronization [req-8856e103-1c22-4ae9-bb4f-11f44fcc0a5f req-dec36a3a-f69c-49f8-9bca-6e029f1bc7e6 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1060.813905] env[65738]: INFO networking_nsxv3.common.synchronization [req-8856e103-1c22-4ae9-bb4f-11f44fcc0a5f req-dec36a3a-f69c-49f8-9bca-6e029f1bc7e6 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1060.814055] env[65738]: INFO networking_nsxv3.common.synchronization [req-8856e103-1c22-4ae9-bb4f-11f44fcc0a5f req-dec36a3a-f69c-49f8-9bca-6e029f1bc7e6 service nova] Enqueued Resource ID: 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 with Priority: HIGHEST for action port [ 1060.814680] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1060.814828] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1060.815011] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 with Priority: HIGHEST for action port [ 1060.815539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.816798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.816798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.816798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.816798] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.817277] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.817277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.817448] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.817448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.817605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.817699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.817803] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a317fa9-760c-4ba8-b3c1-0e44bd930b96',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.320605] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.320962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.320962] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 with status ACTIVE [ 1061.321146] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.321317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.321373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.321558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.321644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.321813] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.321917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.321972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.322132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.322207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.322395] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.322487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.322541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.322676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.322748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.322831] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a317fa9-760c-4ba8-b3c1-0e44bd930b96 is going to be updated. [ 1061.347358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.347531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.347602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.347812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.347974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.348140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a317fa9-760c-4ba8-b3c1-0e44bd930b96" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.728448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: SUCCESS [ 1061.728448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.927716] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 1061.927960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.928150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.928380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.928576] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.928691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.928756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.928965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.929117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.929242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.929315] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.437244] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.437244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.437596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.437596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.437774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.437958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.437958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.438245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.438366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.438703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.438854] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.438854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.438955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.439192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.439488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.439649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.439754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.440113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.440237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.440385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.440506] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.777725] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1062.777937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.778119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.778340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.778509] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.779314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.779314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.779314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.779314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.779314] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.943891] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd260df1-27ce-4a10-8b11-543f9fd7f080: rpc.has_security_group_logging(os_id): False [ 1062.965840] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.966096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.966096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.966285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.966380] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.966682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.966792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.966856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.967057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.967138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.967335] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.967433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.967493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.967649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.967724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.968028] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.969462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.969550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.969695] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.969776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.969866] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be created. [ 1063.050388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.050388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.050388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.050388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.050388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.062373] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: IN_PROGRESS for 2s [ 1063.281048] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.785062] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.287708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.287959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.288116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.288405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.288544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.288693] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1064.331968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.332352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.332451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.332766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.332903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.344290] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1064.395086] env[65738]: INFO networking_nsxv3.common.synchronization [req-e95eabfb-ef24-41d0-9aee-fb80d1197b97 req-b371d7a3-604c-490e-b996-69bf6b73f1ec tempest-ServerPasswordTestJSON-1368453728 tempest-ServerPasswordTestJSON-1368453728-project-member] Enqueued Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1064.395612] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1064.395914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.396042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.396608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.396608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.396608] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.396608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.396863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.396863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.396863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.397028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.757796] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.757949] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-399" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.758082] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-399" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.758417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-399" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.758670] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.758827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.758946] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.759399] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.759399] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.759614] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.759672] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.759744] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.759853] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.759963] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.760167] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.760299] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.781943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.782133] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.782272] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.782448] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-399" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.782791] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b733b12c-61b7-4a81-a22f-16154f67beaf taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.782997] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.783137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.783484] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.783641] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b733b12c-61b7-4a81-a22f-16154f67beaf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.899976] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.900536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.900536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.900536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.900536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.900708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.900817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.900886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.901096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.901142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.901231] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c already deleted. [ 1064.901305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.077753] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 1065.078127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.286266] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.286699] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.286951] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.287323] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.287535] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.287732] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b733b12c-61b7-4a81-a22f-16154f67beaf not found, creating... [ 1065.288045] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.288221] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.288502] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.288724] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.288862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.289374] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.289478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.289599] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.289826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.289972] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.290132] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b733b12c-61b7-4a81-a22f-16154f67beaf is going to be created. [ 1065.317675] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.318038] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.318199] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.318577] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.318830] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.319145] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.081956] env[65738]: INFO networking_nsxv3.common.synchronization [req-e95eabfb-ef24-41d0-9aee-fb80d1197b97 req-45b98599-90ca-4fe8-9330-e5ea8942e096 service nova] Enqueued Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_rules [ 1066.082240] env[65738]: INFO networking_nsxv3.common.synchronization [req-e95eabfb-ef24-41d0-9aee-fb80d1197b97 req-45b98599-90ca-4fe8-9330-e5ea8942e096 service nova] Enqueued Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1066.082442] env[65738]: INFO networking_nsxv3.common.synchronization [req-e95eabfb-ef24-41d0-9aee-fb80d1197b97 req-45b98599-90ca-4fe8-9330-e5ea8942e096 service nova] Enqueued Resource ID: b733b12c-61b7-4a81-a22f-16154f67beaf with Priority: HIGHEST for action port [ 1066.084919] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_rules [ 1066.084919] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1066.084919] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b733b12c-61b7-4a81-a22f-16154f67beaf with Priority: HIGHEST for action port [ 1066.084919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.084919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.084919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.084919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.084919] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.086033] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.086033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.086033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.086196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.086322] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.086591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.086591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.086709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.086997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.086997] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.088038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b733b12c-61b7-4a81-a22f-16154f67beaf taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.088038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.088038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.088206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.088206] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b733b12c-61b7-4a81-a22f-16154f67beaf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.354035] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1066.354035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.354035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.354035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.354325] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.354325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.354325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.354476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.354507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.354571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.354662] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.589986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.590141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.591537] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b733b12c-61b7-4a81-a22f-16154f67beaf with status ACTIVE [ 1066.591745] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.591881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.591977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.592207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.592333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.592464] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.592555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.592644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.592808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.592888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.593126] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.593248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.593343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.593468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.593548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.593646] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b733b12c-61b7-4a81-a22f-16154f67beaf is going to be updated. [ 1066.594771] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.616996] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.616996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.616996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.616996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.616996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.616996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b733b12c-61b7-4a81-a22f-16154f67beaf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.856700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.856871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.856871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.857073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.857254] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.857360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.857427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.857627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.857694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.857784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.857940] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.858055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.858096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.858245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.858397] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.858495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.858556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.858698] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.858773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.858853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.858946] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.882384] env[65738]: INFO networking_nsxv3.common.synchronization [req-2e1da3e1-4f67-4830-bcb0-d33c1ea438ff req-eec8b3a0-66f2-475f-b7fe-96623b3b79f7 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1066.883280] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1066.883605] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.883721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.883831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.884257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.884257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.884389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.884418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.884565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.884650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.884744] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.097840] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.309727] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.310473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.310473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.310473] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.311137] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.312052] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.312052] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.312154] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.312276] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.312517] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.312635] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.312747] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.312858] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.312968] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.313215] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.313355] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.339016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.339274] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.339418] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.339596] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.339969] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-50c79aee-3e64-411a-9703-9c270f2245a7 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.340389] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.340578] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.342413] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.342635] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50c79aee-3e64-411a-9703-9c270f2245a7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.362028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1067.386858] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.387046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.387213] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.387453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.388167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.388167] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.388167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.388167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.388351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.388351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.388569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.388686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.388745] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.388890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.388959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.389828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.389828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.389828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.389828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.389828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.389828] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1067.391378] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.391507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.391638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.391871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.392020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.392325] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.393026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.393026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.393026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.393026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.393026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 already deleted. [ 1067.393026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.511409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.511578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.511654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.511866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.512042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.528783] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1067.604041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.604041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.604041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.604041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.604041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.604041] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c is going to be created. [ 1067.629853] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.630069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.630117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.630331] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.630514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.640774] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: UNINITIALIZED for 2s [ 1067.846133] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.846391] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.846555] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.846829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.846978] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.847161] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 50c79aee-3e64-411a-9703-9c270f2245a7 not found, creating... [ 1067.847427] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.847599] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.847721] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.847942] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.848088] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.848414] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.848621] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.848770] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.849085] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.849611] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.849780] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 50c79aee-3e64-411a-9703-9c270f2245a7 is going to be created. [ 1067.871139] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.871475] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.871569] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.871862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.872098] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.872358] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.092471] env[65738]: INFO networking_nsxv3.common.synchronization [req-4b0e59d4-cc19-4b19-919e-d1b3a4fedbee req-3a0a1420-6567-4449-a465-dcb92dbd0c31 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1068.093232] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGHEST for action security_group_members [ 1068.093656] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.093829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.093929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.094336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.094422] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.094481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.094537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.094690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.094773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.094867] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.153757] env[65738]: INFO networking_nsxv3.common.synchronization [req-4b0e59d4-cc19-4b19-919e-d1b3a4fedbee req-3a0a1420-6567-4449-a465-dcb92dbd0c31 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with Priority: HIGHEST for action port [ 1068.154332] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with Priority: HIGHEST for action port [ 1068.154644] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.154756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.154847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.155129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.155208] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4868d5-ad32-43bc-aef4-07add9d4cf5b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.596929] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.597383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.597383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.597562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.597631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.597859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.598015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.598114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.598303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.598424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.598563] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be updated. [ 1068.621960] env[65738]: INFO networking_nsxv3.common.synchronization [req-2e1da3e1-4f67-4830-bcb0-d33c1ea438ff req-ba6abffb-cae1-4a9a-97cd-124e34de5bd7 service nova] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1068.622187] env[65738]: INFO networking_nsxv3.common.synchronization [req-2e1da3e1-4f67-4830-bcb0-d33c1ea438ff req-ba6abffb-cae1-4a9a-97cd-124e34de5bd7 service nova] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1068.622331] env[65738]: INFO networking_nsxv3.common.synchronization [req-2e1da3e1-4f67-4830-bcb0-d33c1ea438ff req-ba6abffb-cae1-4a9a-97cd-124e34de5bd7 service nova] Enqueued Resource ID: 50c79aee-3e64-411a-9703-9c270f2245a7 with Priority: HIGHEST for action port [ 1068.622961] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_rules [ 1068.623145] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1068.623223] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c79aee-3e64-411a-9703-9c270f2245a7 with Priority: HIGHEST for action port [ 1068.623775] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.623775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.623775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.624023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.624076] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.625113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.625258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.625297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.625528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.625699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.625894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.625894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.626598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.626598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.626598] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.627256] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-50c79aee-3e64-411a-9703-9c270f2245a7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.627415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.627492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.627674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.627750] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50c79aee-3e64-411a-9703-9c270f2245a7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.636871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.637426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.637426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.637426] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.637980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.658696] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e4868d5-ad32-43bc-aef4-07add9d4cf5b with status ACTIVE [ 1068.658696] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.658696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.658696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.659136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.659136] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.659210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.659329] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.659452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.659535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.659931] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.660050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.660050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.660207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.660283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.660611] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e4868d5-ad32-43bc-aef4-07add9d4cf5b is going to be updated. [ 1068.663707] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: IN_PROGRESS for 2s [ 1068.690339] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.690339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.690339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.690339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.690339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.690339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e4868d5-ad32-43bc-aef4-07add9d4cf5b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.130519] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.131773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.131883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.132053] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50c79aee-3e64-411a-9703-9c270f2245a7 with status ACTIVE [ 1069.132383] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.132383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.132383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.132500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.133199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.133199] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.133199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.133199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.133199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.133199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.133426] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.133498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.133537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.133707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.133806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.133894] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50c79aee-3e64-411a-9703-9c270f2245a7 is going to be updated. [ 1069.161590] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.161889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.161889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.162094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.162278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.162482] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50c79aee-3e64-411a-9703-9c270f2245a7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.383153] env[65738]: INFO networking_nsxv3.common.synchronization [req-241cf8d7-d8f9-41fb-bc08-317225a6ad55 req-89ff9046-fa43-4df4-a1a8-292a7f5c30fd tempest-ServerTagsTestJSON-1129264773 tempest-ServerTagsTestJSON-1129264773-project-member] Enqueued Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1069.384078] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1069.384201] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.384285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.384315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.384574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.384726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.384820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.385828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.385828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.385828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.385828] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.549552] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1069.549884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.638431] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.654089] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: SUCCESS [ 1069.654089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.654251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.654392] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.654555] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.654663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.654731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.654868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.654966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.655080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.655193] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.744599] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.745395] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-993" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.745395] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-993" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.745395] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-993" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.745578] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.745739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.745851] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.746097] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.746299] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.746426] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.746533] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.746638] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.746739] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.746840] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.746939] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.747664] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.766859] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.767059] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.767204] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.767385] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-993" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.767710] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-4df1dc7b-4222-4736-be83-f00c1ab5a85e taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.768016] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.768097] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.768417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.768555] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4df1dc7b-4222-4736-be83-f00c1ab5a85e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.890175] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.891528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.891528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.891837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.891837] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 already deleted. [ 1069.891837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.140784] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.141177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.141453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.141821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.141963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.142184] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 is going to be created. [ 1070.157661] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.157872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.157950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.158209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.158398] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.158488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.158550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.158705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.158782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.158879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.159263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.159381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.159492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.159687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.159850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.159937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.159994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.160178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.160260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160402] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.180088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.180491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.180491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.180565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.180710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.195185] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: UNINITIALIZED for 2s [ 1070.272339] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.272709] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.272833] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.273318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.273651] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.273980] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 4df1dc7b-4222-4736-be83-f00c1ab5a85e not found, creating... [ 1070.274428] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.274725] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.274926] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.275359] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.275598] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.276161] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.276380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.276548] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.277021] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.277344] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.277605] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 4df1dc7b-4222-4736-be83-f00c1ab5a85e is going to be created. [ 1070.358233] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.358233] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.358233] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.358560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.359148] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.359700] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.662781] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc457931-d7fc-49b3-aa99-8b32b5550b7c: rpc.has_security_group_logging(os_id): False [ 1070.673600] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 in Status: SUCCESS [ 1070.673828] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 deletion is rescheduled due to dependency. [ 1070.673936] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.685248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.685248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.685248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.685248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.685248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.685248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.685673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.685673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.685768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.685811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.686598] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.686598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.686598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.686598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.686598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.686907] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.687424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.687424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.687424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.687424] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.687424] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c is going to be created. [ 1070.757948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.757948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.757948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.757948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.758298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.769536] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: IN_PROGRESS for 2s [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [req-241cf8d7-d8f9-41fb-bc08-317225a6ad55 req-89d8f092-82ac-4379-a0ba-1f04a9c0b9aa service nova] Enqueued Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_rules [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [req-241cf8d7-d8f9-41fb-bc08-317225a6ad55 req-89d8f092-82ac-4379-a0ba-1f04a9c0b9aa service nova] Enqueued Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [req-241cf8d7-d8f9-41fb-bc08-317225a6ad55 req-89d8f092-82ac-4379-a0ba-1f04a9c0b9aa service nova] Enqueued Resource ID: 4df1dc7b-4222-4736-be83-f00c1ab5a85e with Priority: HIGHEST for action port [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_rules [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1071.066466] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df1dc7b-4222-4736-be83-f00c1ab5a85e with Priority: HIGHEST for action port [ 1071.066466] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.066466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.066466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.066466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.066728] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.068633] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.068761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.071900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.071900] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.071900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-4df1dc7b-4222-4736-be83-f00c1ab5a85e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.071900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.071900] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4df1dc7b-4222-4736-be83-f00c1ab5a85e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.574063] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.574063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.574063] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.575559] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4df1dc7b-4222-4736-be83-f00c1ab5a85e with status ACTIVE [ 1071.575559] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.575769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.575837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.576172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.576351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.577021] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.577296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.577977] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4df1dc7b-4222-4736-be83-f00c1ab5a85e is going to be updated. [ 1071.602273] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.602442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.602526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.602822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.602980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.603203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4df1dc7b-4222-4736-be83-f00c1ab5a85e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.080698] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.209630] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: SUCCESS [ 1072.209882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.210064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.210382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.210613] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.210732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.210796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.210952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.211042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.211196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.211289] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.584897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.585297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.585297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.586115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.586115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.586115] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 is going to be created. [ 1072.618932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.618932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.618932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.619211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.619409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.631932] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: UNINITIALIZED for 2s [ 1072.713949] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.782662] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: SUCCESS [ 1072.782908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.217027] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da85289d-08d2-4040-ba9b-31d7eea34c68: rpc.has_security_group_logging(os_id): False [ 1073.239981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.240192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.240276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.240454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.240544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.240799] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.240943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.240943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.241207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.241321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.241444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 is going to be created. [ 1073.277464] env[65738]: INFO networking_nsxv3.common.synchronization [req-eefabcaa-9932-4e55-a0d4-bf0d73a95434 req-21763b0d-9a98-4be8-a3a3-1c07fada0adf tempest-ServerRescueNegativeTestJSON-187342454 tempest-ServerRescueNegativeTestJSON-187342454-project-member] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 1073.278216] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGHEST for action security_group_members [ 1073.278546] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.278666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.278735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.278924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.279142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.279287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.279354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.279519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.279780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.279894] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.342884] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.343173] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.343284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.343746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.343941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.385663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: IN_PROGRESS for 2s [ 1073.783441] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.783441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.783441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.783884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.807379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.807734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.807896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.807985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.808270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.808377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.808507] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be updated. [ 1073.839135] env[65738]: INFO networking_nsxv3.common.synchronization [req-732e4a60-2920-4143-bbf8-1e0688cb5d34 req-298f8ee7-e113-46cb-85e6-ce1afabc4351 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1073.839968] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1073.840285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.840419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.840489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.840712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.840890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.841134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.841134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.841276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.841363] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.841485] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.847658] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.847810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.848123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.848488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.848682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.862374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: IN_PROGRESS for 2s [ 1074.343998] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.643166] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: SUCCESS [ 1074.643467] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.643598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.643855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.644123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.644303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.644365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.644584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.644720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.644850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.644960] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.845992] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.147866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.148652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.148652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.148652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.148652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.148944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.148944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.148944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.149094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.149288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.149468] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.149570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.149635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.149788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.149934] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.150039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.150104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.150249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.150330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.150417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.150516] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.348642] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.348854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.348947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.349284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.349401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.349509] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1075.380991] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.381307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.381387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.381623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.381872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.395399] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1075.399999] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: SUCCESS [ 1075.400250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.652979] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8eba3bd-4aa0-4ad6-921f-6d4d71a20221: rpc.has_security_group_logging(os_id): False [ 1075.671856] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.672061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.672183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.672474] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.672660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.672870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.672995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.673082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.673307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.673414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.673641] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.673748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.673821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.673968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.674088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.674311] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.674430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.674509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.674671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.674755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.674926] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 is going to be created. [ 1075.741781] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.741952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.742319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.742548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.756568] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: IN_PROGRESS for 2s [ 1075.873589] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 in Status: SUCCESS [ 1075.873988] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 deletion is rescheduled due to dependency. [ 1075.874058] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.411886] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1077.412189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.770217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: SUCCESS [ 1077.770452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.841078] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1078.842248] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1078.925098] env[65738]: INFO networking_nsxv3.common.synchronization [None req-0a508d47-10a0-4796-9fca-573dba881c6e tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1078.925850] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1078.926288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.926497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.926548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.926937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.927037] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.104115] env[65738]: INFO networking_nsxv3.common.synchronization [None req-5368b6be-6f6a-4daa-95dc-986ead261d42 tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1079.108184] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1079.108640] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.108758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.451552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.451730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.451730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.451964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.452352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.452352] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc already deleted. [ 1079.452352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.452483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.452639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.452722] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.973202] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.974018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.974018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.974018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.974018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.974018] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc already deleted. [ 1079.974018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.057738] env[65738]: INFO networking_nsxv3.common.synchronization [req-5332fee8-a9a0-4b05-bd8a-e838776c051b req-27b99eb2-2052-42f9-b639-e5d68cb8fca3 tempest-ServerPasswordTestJSON-1368453728 tempest-ServerPasswordTestJSON-1368453728-project-member] Enqueued Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1081.058728] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGHEST for action security_group_members [ 1081.059370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.059507] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.059595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.059784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.060077] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.060217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.060304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.060441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.060560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.060698] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.562980] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.563165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.563234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.563444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.563536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.563733] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.563835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.563898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.564061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.564143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.564228] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c is going to be updated. [ 1081.597770] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.597770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.597770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.597770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.597770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.610246] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: IN_PROGRESS for 2s [ 1083.300419] env[65738]: INFO networking_nsxv3.common.synchronization [req-c30139e7-c51d-4647-b1e4-a3162f264a1f req-6d0846b6-77e6-4540-b613-1c22eb47a676 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1083.301172] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1083.301501] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.301615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.302035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.302240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.302416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.302667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.302667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.302752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.302830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.302927] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.624167] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c in Status: SUCCESS [ 1083.625032] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c deletion is rescheduled due to dependency. [ 1083.625032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.805314] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.308778] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.813500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.813500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.813500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.813823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.813823] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.813922] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1084.853054] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.853793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.853951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.854290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.854915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.871085] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1086.298685] env[65738]: INFO networking_nsxv3.common.synchronization [req-cd684784-8ca3-404b-9e43-a803294d4131 req-ae4a8045-22a2-4d0c-820b-8e687140b97a tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1086.299615] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGHEST for action security_group_members [ 1086.300140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.300789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.302461] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.302461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.302461] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.805171] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.805361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.805437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.805642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.805720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.805942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.806083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.806147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.806342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.806801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.806801] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23565e98-53ea-4113-9741-85efc55da889 is going to be updated. [ 1086.842500] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.842500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.843406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.843406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.843406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.856296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: IN_PROGRESS for 2s [ 1086.881268] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1086.882143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.305037] env[65738]: INFO networking_nsxv3.common.synchronization [req-6735aa1e-6a05-42ad-a3b5-2b20d1e8fc04 req-79825071-090c-473e-9425-82aa55070353 tempest-ServerTagsTestJSON-1129264773 tempest-ServerTagsTestJSON-1129264773-project-member] Enqueued Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1087.305896] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGHEST for action security_group_members [ 1087.306304] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.306454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.306523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.306774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.306934] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.307349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.307349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.307349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.307483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.307542] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.811076] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.811076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.811076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.811438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.811588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.811811] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.811948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.812237] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.812428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.812520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.812620] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 is going to be updated. [ 1087.864948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.865169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.865220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.865430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.865571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.877439] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: IN_PROGRESS for 2s [ 1088.857180] env[65738]: INFO networking_nsxv3.common.synchronization [req-cfd5b144-48af-4ece-b21d-8d25b3b98d93 req-96e2370c-f516-4216-97ac-af8ec776f2ed tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1088.858811] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1088.859193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.859339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.859591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.859692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.859871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.860016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.860089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.860321] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.860464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.860600] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.873135] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23565e98-53ea-4113-9741-85efc55da889 in Status: SUCCESS [ 1088.873135] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23565e98-53ea-4113-9741-85efc55da889 deletion is rescheduled due to dependency. [ 1088.873135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.290761] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.291018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.291164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.291480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.291767] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.291978] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.292104] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.292420] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.292567] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.292779] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.292894] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.293023] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.293168] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.293357] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.293488] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.293642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.333815] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.333815] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.333815] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.334215] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-607" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.334423] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-897f3468-7c18-4cdb-afca-3153a4b9e2f2 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.334637] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.334815] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.335235] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.335435] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('897f3468-7c18-4cdb-afca-3153a4b9e2f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.363552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.363839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.363976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.364261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.364400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.364723] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.364879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.364993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.365248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.365374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.365504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc already deleted. [ 1089.365684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.839483] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.840147] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.840147] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.840147] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.840463] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.840562] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 897f3468-7c18-4cdb-afca-3153a4b9e2f2 not found, creating... [ 1089.840933] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.841191] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.841339] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.841603] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.841788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.842140] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.842352] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.842516] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.842719] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.842902] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.843082] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 897f3468-7c18-4cdb-afca-3153a4b9e2f2 is going to be created. [ 1089.869512] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.869512] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.869512] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.869512] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.870110] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.870110] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.888040] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 in Status: SUCCESS [ 1089.888233] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 deletion is rescheduled due to dependency. [ 1089.888368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.557848] env[65738]: INFO networking_nsxv3.common.synchronization [req-cfd5b144-48af-4ece-b21d-8d25b3b98d93 req-fccf353d-3c44-4f3e-a3de-c183c35322a5 service nova] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1090.557848] env[65738]: INFO networking_nsxv3.common.synchronization [req-cfd5b144-48af-4ece-b21d-8d25b3b98d93 req-fccf353d-3c44-4f3e-a3de-c183c35322a5 service nova] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1090.557848] env[65738]: INFO networking_nsxv3.common.synchronization [req-cfd5b144-48af-4ece-b21d-8d25b3b98d93 req-fccf353d-3c44-4f3e-a3de-c183c35322a5 service nova] Enqueued Resource ID: 897f3468-7c18-4cdb-afca-3153a4b9e2f2 with Priority: HIGHEST for action port [ 1090.558390] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_rules [ 1090.558531] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1090.558621] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897f3468-7c18-4cdb-afca-3153a4b9e2f2 with Priority: HIGHEST for action port [ 1090.558901] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.559038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.559138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.559301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.559380] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.560837] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.560837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.560837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.561679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.561679] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.561679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.561679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.561679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.561679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.561679] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.565218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-897f3468-7c18-4cdb-afca-3153a4b9e2f2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.565218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.565218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.565218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.565218] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('897f3468-7c18-4cdb-afca-3153a4b9e2f2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.065594] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.067405] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.067405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.068994] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 897f3468-7c18-4cdb-afca-3153a4b9e2f2 with status ACTIVE [ 1091.069263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.069456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.069947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.069947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.069947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.070556] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.070556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.070556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.070822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.070822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.071573] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.071573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.071573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.071725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.071725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.071875] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 897f3468-7c18-4cdb-afca-3153a4b9e2f2 is going to be updated. [ 1091.104225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.104538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.104646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.104894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.105138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.105345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-897f3468-7c18-4cdb-afca-3153a4b9e2f2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.567943] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.070142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.070556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.070556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.070754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.070896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.071043] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc is going to be created. [ 1092.102847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.103061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.103061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.103280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.103453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.113806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: UNINITIALIZED for 2s [ 1094.126402] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: SUCCESS [ 1094.126671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.126981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.127288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.127494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.127644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.127726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.127935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.128087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.128122] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.128225] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.630773] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.133219] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11be5bab-0ed1-4fcd-8cd0-a3658db651bc: rpc.has_security_group_logging(os_id): False [ 1095.153369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.153590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.153590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.153810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.153898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.154204] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.154310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.154379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.154595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.154677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.154785] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc is going to be created. [ 1095.225083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.225286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.225286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.225556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.225766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.236795] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: IN_PROGRESS for 2s [ 1095.559720] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1095.559937] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1097.250790] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: SUCCESS [ 1097.251177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.561107] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1100.561107] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1101.465140] env[65738]: INFO networking_nsxv3.common.synchronization [None req-eafdceda-b0c1-47be-b39f-8c75597712fc tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1101.466187] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1101.466674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.467677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.469371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.469578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.469724] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.562648] env[65738]: INFO networking_nsxv3.common.synchronization [None req-2599e16b-c413-4358-afaf-234e0b621fc5 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1101.562648] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1101.562648] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.562648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.996442] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.996442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.996618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.996770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.996862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.996984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 already deleted. [ 1101.997109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.998035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.998035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.998035] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.519683] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.519898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.519898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.520249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.520347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.520448] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 already deleted. [ 1102.520529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.061289] env[65738]: INFO networking_nsxv3.common.synchronization [req-337655ab-0238-4371-b64a-e90b20eccdce req-947b33e6-277f-4073-b471-832f4b9fdcbb tempest-ImagesOneServerTestJSON-946912510 tempest-ImagesOneServerTestJSON-946912510-project-member] Enqueued Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1106.061871] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGHEST for action security_group_members [ 1106.062494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.062494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.062494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.062739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.062875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.062967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.063038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.063185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.063270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.063365] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.511796] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd44bf82-e007-4952-9b34-c76686b7ab93 req-5bf0352c-e285-443a-a228-bd01353b8914 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1106.512370] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1106.512674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.512794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.512860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.513097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.513257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.513357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.513418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.513574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.513654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.513745] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.565950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.566195] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.566252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.566809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.566809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.566809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.566809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.566989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.566989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.567122] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.567171] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d is going to be updated. [ 1106.597642] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.597909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.597909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.598070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.598398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.608542] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: IN_PROGRESS for 2s [ 1106.809603] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.809812] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.809937] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.810226] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.810490] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.810649] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.810846] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.812571] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.812858] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.813182] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.813304] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.813417] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.813527] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.813639] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.813768] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.813953] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.833975] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.834158] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.834292] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.834472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.834787] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-6413d10d-09a4-4d89-895c-fca8d7accd35 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.834965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.835183] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.835419] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.835580] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6413d10d-09a4-4d89-895c-fca8d7accd35',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.890207] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4d5943d-59d7-4887-b746-f7926104d88b req-75028a31-4cc1-49b4-b59b-ca96f795988b tempest-ListImageFiltersTestJSON-158409542 tempest-ListImageFiltersTestJSON-158409542-project-member] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1106.890798] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1106.891364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.891542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.891630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.891879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.892088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.892205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.892271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.892469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.892566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.892691] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.017434] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.338548] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.338548] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.338548] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.339094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.339094] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.339166] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 6413d10d-09a4-4d89-895c-fca8d7accd35 not found, creating... [ 1107.339424] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.339580] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.339694] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.339925] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.340083] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.340378] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.340524] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.340642] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.340918] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.341061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.341202] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 6413d10d-09a4-4d89-895c-fca8d7accd35 is going to be created. [ 1107.365870] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.366123] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.366227] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.366506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.366738] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.367071] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.394788] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.520830] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.897752] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.023583] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.023748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.023790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.024012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.024116] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.024218] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1108.059100] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.059100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.059100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.059100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.059100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.060983] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd44bf82-e007-4952-9b34-c76686b7ab93 req-54d20d9d-c29a-4080-b93c-417560050dce service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1108.061235] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd44bf82-e007-4952-9b34-c76686b7ab93 req-54d20d9d-c29a-4080-b93c-417560050dce service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1108.061410] env[65738]: INFO networking_nsxv3.common.synchronization [req-bd44bf82-e007-4952-9b34-c76686b7ab93 req-54d20d9d-c29a-4080-b93c-417560050dce service nova] Enqueued Resource ID: 6413d10d-09a4-4d89-895c-fca8d7accd35 with Priority: HIGHEST for action port [ 1108.061955] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1108.062602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1108.062735] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413d10d-09a4-4d89-895c-fca8d7accd35 with Priority: HIGHEST for action port [ 1108.063111] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.063179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.063212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.063396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.063473] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.064612] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.064612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.064760] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6413d10d-09a4-4d89-895c-fca8d7accd35 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.064760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.064955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.064955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.065023] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6413d10d-09a4-4d89-895c-fca8d7accd35',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.069389] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1108.400346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.400346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.400761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.400869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.401035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.401181] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be updated. [ 1108.437228] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.437367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.437435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.437650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.437791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.447647] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1108.567318] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.567447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.567638] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6413d10d-09a4-4d89-895c-fca8d7accd35 with status ACTIVE [ 1108.567836] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.567983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.568045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.568230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.568315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.568485] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.568595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.568680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.568814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.568888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.569080] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.569174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.569234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.569369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.569439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.569522] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6413d10d-09a4-4d89-895c-fca8d7accd35 is going to be updated. [ 1108.589454] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.589679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.589765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.589982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.590192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.590407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6413d10d-09a4-4d89-895c-fca8d7accd35" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.620095] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d in Status: SUCCESS [ 1108.620327] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d deletion is rescheduled due to dependency. [ 1108.620448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.081215] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1110.081593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.081593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.081891] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.082087] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.082203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.082267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.082412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.082495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.082591] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.458040] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1110.458214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.585027] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.087074] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.415149] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4d1ccf5-5193-41e2-bacd-b63a41865114 req-0840c139-31b7-4294-a784-17d43b2a7d40 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1111.415599] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1111.415882] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.417409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.417409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.417409] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.590069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.590294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.590336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.590580] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.590723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.590950] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1111.622905] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.622905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.622905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.622905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.622905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.633549] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1111.728047] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.728047] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.728220] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.728485] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.728816] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.729064] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.729231] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.729447] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.729590] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.729795] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.729928] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.730063] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.730173] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.730281] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.730385] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.730516] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.752112] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.752298] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.752425] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.752608] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-566" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.752968] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-ca91e49d-9548-4854-a18a-808f9602331b taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.753177] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.753335] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.753669] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.753810] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca91e49d-9548-4854-a18a-808f9602331b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.919659] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.256562] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.256909] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.256909] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.257241] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.257402] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.257587] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port ca91e49d-9548-4854-a18a-808f9602331b not found, creating... [ 1112.257873] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.258063] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.258276] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.258454] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.258617] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.259079] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.259285] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.259404] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.259628] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.259761] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.259908] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: ca91e49d-9548-4854-a18a-808f9602331b is going to be created. [ 1112.285547] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.285547] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.285547] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.285739] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.285920] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.286186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.422444] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.925388] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.925511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.925551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.925776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.925857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.925956] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be updated. [ 1112.957930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.958161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.958161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.958341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.958465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.968179] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 1112.994091] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4d1ccf5-5193-41e2-bacd-b63a41865114 req-5a975b1c-0c69-4c73-a9e8-d787a77c3593 service nova] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 1112.994292] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4d1ccf5-5193-41e2-bacd-b63a41865114 req-5a975b1c-0c69-4c73-a9e8-d787a77c3593 service nova] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1112.994462] env[65738]: INFO networking_nsxv3.common.synchronization [req-b4d1ccf5-5193-41e2-bacd-b63a41865114 req-5a975b1c-0c69-4c73-a9e8-d787a77c3593 service nova] Enqueued Resource ID: ca91e49d-9548-4854-a18a-808f9602331b with Priority: HIGHEST for action port [ 1112.994895] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_rules [ 1112.995051] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1112.995151] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca91e49d-9548-4854-a18a-808f9602331b with Priority: HIGHEST for action port [ 1112.995398] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.995515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.995584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.995772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.995853] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.997178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.997178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.997178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca91e49d-9548-4854-a18a-808f9602331b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.997178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.997178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.997497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.997497] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca91e49d-9548-4854-a18a-808f9602331b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.500575] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.501022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.501157] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca91e49d-9548-4854-a18a-808f9602331b with status ACTIVE [ 1113.501390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.501548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.501669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.501969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.502155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.502438] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.502690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.502690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.502904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.503048] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.503347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.503490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.503578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.503797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.503920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.504059] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca91e49d-9548-4854-a18a-808f9602331b is going to be updated. [ 1113.529296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.529496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.529557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.529744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.529893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.530056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca91e49d-9548-4854-a18a-808f9602331b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.658876] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1113.659101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.659279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.659505] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.659704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.659828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.659886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.660060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.660139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.660228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.660321] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.163349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.163517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.163569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.163774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.163933] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.164071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.164227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.164291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.164373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.164458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.164620] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.164725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.164821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.164905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.165056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.165164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.165226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.165365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.165451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.165726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.165726] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.668394] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1114.694678] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.694830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.694907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.696023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.696023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.696298] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.696298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.696298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.696485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.696536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.696706] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.696793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.696841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.697030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.697109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.697177] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1114.765593] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.765751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.765810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.766059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.766342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.782079] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1114.979993] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 1114.980243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.980413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.981114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.981114] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.981114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.981114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.981376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.981376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.981486] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.094280] env[65738]: INFO networking_nsxv3.common.synchronization [None req-30f88b99-0869-41ad-8784-e099d0e90444 tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1115.094548] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1115.094863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.094979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.095052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.095307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.095384] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.175960] env[65738]: INFO networking_nsxv3.common.synchronization [None req-37233185-40de-47c4-9f80-322154e5535d tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1115.176592] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1115.176895] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.176995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.485557] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.616475] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.616647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.616647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.616780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.616868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.616970] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1c642a-c375-4b06-8293-de7939b50479 already deleted. [ 1115.617065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.617282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.617475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.617562] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.987874] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.137871] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.138178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.138294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.138593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.138717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.138828] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1c642a-c375-4b06-8293-de7939b50479 already deleted. [ 1116.139063] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.491040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.491354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.491529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.491941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.492043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.492207] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be updated. [ 1116.529347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.529513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.529587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.529971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.529971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.543984] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 1116.799444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1116.799444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.180354] env[65738]: INFO networking_nsxv3.common.synchronization [req-6016862a-90fa-4fee-8b43-10609029d773 req-15d0b70c-75c2-45bb-82ff-8b0f0ca62e4e tempest-DeleteServersTestJSON-816961895 tempest-DeleteServersTestJSON-816961895-project-member] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1117.180930] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGHEST for action security_group_members [ 1117.182075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.182075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.182075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.182320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.182455] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.182622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.182722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.182960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.183107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.183210] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.253139] env[65738]: INFO networking_nsxv3.common.synchronization [req-d87d62df-90eb-4929-9e18-f92767c80347 req-6fa3de11-e4f6-408b-a661-3ff2dda8f128 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1117.253139] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1117.253139] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.253842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.254262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.256785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.256785] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.256785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.256785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.256785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.256785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.256785] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.685873] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.685873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.685873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.686060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.686138] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.686364] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.686469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.686529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.686696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.686773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.686861] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be updated. [ 1117.731441] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.731654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.731718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.733019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.733019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.743194] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: IN_PROGRESS for 2s [ 1117.760644] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.760644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.760644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.761015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.761066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.761330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.761438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.761501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.761700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.761783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.761871] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 already deleted. [ 1117.761950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.095089] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.095302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.095425] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.095684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.095968] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.096169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.096303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.096522] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.096683] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.096905] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.097068] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.097141] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.097244] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.097363] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.097468] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.097615] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.120296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.120420] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.120521] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.120807] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-379" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.121149] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-1f0702f8-c4ac-4f70-bffe-c05dba755128 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.121324] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.121442] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.121789] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.121928] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0702f8-c4ac-4f70-bffe-c05dba755128',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.555348] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 1118.555348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.555348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.555729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.555729] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.555879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.555942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.556112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.556221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.556340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.556469] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.624812] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.624812] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.624812] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.625240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.625240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.625363] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 1f0702f8-c4ac-4f70-bffe-c05dba755128 not found, creating... [ 1118.625735] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.626434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.626434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.626434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.626434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.626758] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.626927] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.627052] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.627276] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.627411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.627555] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 1f0702f8-c4ac-4f70-bffe-c05dba755128 is going to be created. [ 1118.653508] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.653744] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.653894] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.654141] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.654383] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.654614] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.993579] env[65738]: INFO networking_nsxv3.common.synchronization [req-616cc571-385a-4861-a73c-cf7d1addad8c req-97677a01-7181-414c-88ff-3923779f0f2c tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1118.994176] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1118.994494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.994618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.994680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.994942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.995127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.995229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.995292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.995658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.995658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.995658] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.058417] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.335959] env[65738]: INFO networking_nsxv3.common.synchronization [req-d87d62df-90eb-4929-9e18-f92767c80347 req-2450a38e-b579-48fb-9ad7-0cb6331f2f21 service nova] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1119.336237] env[65738]: INFO networking_nsxv3.common.synchronization [req-d87d62df-90eb-4929-9e18-f92767c80347 req-2450a38e-b579-48fb-9ad7-0cb6331f2f21 service nova] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1119.336454] env[65738]: INFO networking_nsxv3.common.synchronization [req-d87d62df-90eb-4929-9e18-f92767c80347 req-2450a38e-b579-48fb-9ad7-0cb6331f2f21 service nova] Enqueued Resource ID: 1f0702f8-c4ac-4f70-bffe-c05dba755128 with Priority: HIGHEST for action port [ 1119.337154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_rules [ 1119.337241] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1119.337348] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0702f8-c4ac-4f70-bffe-c05dba755128 with Priority: HIGHEST for action port [ 1119.337700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.337842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.337909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.338147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.338238] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.340214] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.340319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.340387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.340598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.340774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.342449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.342449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.342449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.342449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.342449] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.342449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f0702f8-c4ac-4f70-bffe-c05dba755128 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.343131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.343131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.343131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.343131] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0702f8-c4ac-4f70-bffe-c05dba755128',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.498649] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.560983] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13e04b13-1f3c-4f36-a68f-be19736a3742: rpc.has_security_group_logging(os_id): False [ 1119.579609] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.579723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.579793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.580018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.598924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.599259] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.599384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.599502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.599652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.599733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.599822] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be updated. [ 1119.658773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.658909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.658981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.659212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.659356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.670921] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 1119.754093] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb392433-b27c-4f33-a766-634f0f6c0dcb in Status: SUCCESS [ 1119.754283] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb deletion is rescheduled due to dependency. [ 1119.754397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.840954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.841198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.845466] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f0702f8-c4ac-4f70-bffe-c05dba755128 with status ACTIVE [ 1119.845726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.845860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.845955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.846328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.846328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.846462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.846597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.846630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.846751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.846825] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.847012] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.847109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.847167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.847305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.847376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.847458] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f0702f8-c4ac-4f70-bffe-c05dba755128 is going to be updated. [ 1119.848543] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.879168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.879168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.879168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.879168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.879673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.879673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f0702f8-c4ac-4f70-bffe-c05dba755128" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.001033] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.352568] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.503607] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.503715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.503797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.504813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.504813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.504813] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1120.538272] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.538515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.538515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.538779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.538837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.552936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1120.855609] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.855897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.855897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.856066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.856207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.856252] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 is going to be created. [ 1120.884692] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.884867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.884911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.885180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.885345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.896120] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: UNINITIALIZED for 2s [ 1121.684371] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 1121.684502] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.564049] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1122.564444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.723808] env[65738]: INFO networking_nsxv3.common.synchronization [req-dda67286-bfd9-4a15-994e-80b2b902a234 req-0f37b06e-f6e8-4f66-9666-fb47c72c5b7a tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1122.724393] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1122.724729] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.724854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.724921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.725130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.725289] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.725396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.725430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.725577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.725658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.725749] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.906173] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: SUCCESS [ 1122.906407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.906583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.906822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.907032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.907185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.907252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.907454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.907542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.907660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.907751] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.063203] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.063203] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.063203] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.063203] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.063203] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.063203] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.063772] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.064137] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.067018] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.067018] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.067018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.067018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.067018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.067018] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.067018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.067018] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.086450] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.086585] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.086707] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.086898] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.087234] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-48194f38-b674-4782-be35-81c041334cb8 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.087411] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.087532] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.087859] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.088008] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48194f38-b674-4782-be35-81c041334cb8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.228041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.228198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.228267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.228501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.228598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.228811] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.228918] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.228994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.229220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.229350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.229501] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1123.260312] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.260498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.260658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.260933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.261135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.278264] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1123.409621] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.590935] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.591390] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.591566] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.591901] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.592132] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.592357] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 48194f38-b674-4782-be35-81c041334cb8 not found, creating... [ 1123.592752] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.593215] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.593380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.593584] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.593797] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.594366] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.594541] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.594586] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.594889] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.595084] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.595272] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 48194f38-b674-4782-be35-81c041334cb8 is going to be created. [ 1123.617802] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.618091] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.618229] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.618617] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.618895] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.619220] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.912535] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 920ae10a-0841-419d-a6d6-5fc98d4eb318: rpc.has_security_group_logging(os_id): False [ 1123.932369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.932623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.932693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.932949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.933103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.933400] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.933525] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.933621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.933833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.933946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.934071] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 is going to be created. [ 1124.029853] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.030019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.030062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.030289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.030481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.044230] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: IN_PROGRESS for 2s [ 1124.325547] env[65738]: INFO networking_nsxv3.common.synchronization [req-dda67286-bfd9-4a15-994e-80b2b902a234 req-16cd035e-919c-45b9-880e-e62a6ee54b55 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1124.325695] env[65738]: INFO networking_nsxv3.common.synchronization [req-dda67286-bfd9-4a15-994e-80b2b902a234 req-16cd035e-919c-45b9-880e-e62a6ee54b55 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1124.325775] env[65738]: INFO networking_nsxv3.common.synchronization [req-dda67286-bfd9-4a15-994e-80b2b902a234 req-16cd035e-919c-45b9-880e-e62a6ee54b55 service nova] Enqueued Resource ID: 48194f38-b674-4782-be35-81c041334cb8 with Priority: HIGHEST for action port [ 1124.326333] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1124.326501] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1124.326564] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48194f38-b674-4782-be35-81c041334cb8 with Priority: HIGHEST for action port [ 1124.326890] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.327043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.327779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.328013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.328797] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.329776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.329882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.330121] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-48194f38-b674-4782-be35-81c041334cb8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.330242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.330311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.330481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.330577] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48194f38-b674-4782-be35-81c041334cb8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.832802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.833134] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.833361] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48194f38-b674-4782-be35-81c041334cb8 with status ACTIVE [ 1124.833606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.833786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.833870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.834148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.834279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.834577] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.834799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.834850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.835104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.835757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.835757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.835757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.835757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.835944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.835944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.835996] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48194f38-b674-4782-be35-81c041334cb8 is going to be updated. [ 1124.861360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.861510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.861615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.861786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.861923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.862094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48194f38-b674-4782-be35-81c041334cb8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.290051] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1125.290256] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 deletion is rescheduled due to dependency. [ 1125.290379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.290672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.290884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.291144] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.291263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.291326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.291478] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.291552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.291649] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.795291] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.057120] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: SUCCESS [ 1126.057599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.296690] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.802548] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.802548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.802548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.802548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.802548] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1126.834283] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.834283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.834283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.834519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.834550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.844208] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1128.866410] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1128.866835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.867011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.867330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.867634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.867813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.868185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.868454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.868594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.868724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.868863] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.327390] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1129.327491] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1129.371528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.371743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.372886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.372886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.372886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.373317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.373317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.373317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.373317] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.373466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.373466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.373572] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.373868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.373868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.373868] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.563752] env[65738]: INFO networking_nsxv3.common.synchronization [req-d221aa57-a04f-41ce-b83c-87618cca1470 req-d54271db-186f-4fcd-ac16-f702c79140fb tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1129.563752] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1129.565636] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.568603] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.568603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.568603] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.877756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1129.919412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.919565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.919662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.920166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.920272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.920565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.920674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.920720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.920853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.920929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.921143] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.921569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.921791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.922595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.922749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.923059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.923696] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.923788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.924035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.924148] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.924265] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1129.956289] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.956531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.956592] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.956857] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.957129] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.957287] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.957402] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.957612] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.957757] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.957962] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.958571] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.958715] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.958838] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.958940] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.959058] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.959195] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.992796] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.993109] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.993299] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.993498] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.993847] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.994056] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.994188] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.994530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.994676] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d50b6-ea3e-4ec3-a60b-104c696657dc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.012050] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.012291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.012291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.012486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.012668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.030590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1130.062635] env[65738]: INFO networking_nsxv3.common.synchronization [req-3b2d167f-4862-4243-826c-cd0d171ba2c9 req-042aadb6-f5d6-4632-9d07-992d7f2a3c2d tempest-ListImageFiltersTestJSON-158409542 tempest-ListImageFiltersTestJSON-158409542-project-member] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1130.062635] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGHEST for action security_group_members [ 1130.062944] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.063177] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.063350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.063552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.063774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.064430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.064430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.064430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.064430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.064430] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.070821] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.070966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.071047] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.071247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.071336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.071553] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.071670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.071732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.071879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.071949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.072045] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1c642a-c375-4b06-8293-de7939b50479 already deleted. [ 1130.072166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.498200] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.498471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.498642] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.498968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.499179] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.499367] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 8d6d50b6-ea3e-4ec3-a60b-104c696657dc not found, creating... [ 1130.499676] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.499883] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.500024] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.500290] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.500455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.500844] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.501193] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.501368] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.501629] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.501802] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.501957] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 8d6d50b6-ea3e-4ec3-a60b-104c696657dc is going to be created. [ 1130.526119] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.526414] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.526579] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.526885] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.527172] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.527432] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.567356] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.567623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.567767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.568094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.568223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.568615] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.568759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.568849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.569075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.569182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.569306] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be updated. [ 1130.606404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.606404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.606404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.606404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.606641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.625663] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: IN_PROGRESS for 2s [ 1130.781656] env[65738]: INFO networking_nsxv3.common.synchronization [None req-dcb94b31-50ab-404b-a70f-d1e6afc683dc tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1130.782384] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1130.782768] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.782768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.782768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.782972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.783141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.783234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.783292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.783446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.783517] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.783643] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.210617] env[65738]: INFO networking_nsxv3.common.synchronization [req-d221aa57-a04f-41ce-b83c-87618cca1470 req-2529caa9-85e9-4fff-87b4-9613cefc1ead service nova] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1131.210617] env[65738]: INFO networking_nsxv3.common.synchronization [req-d221aa57-a04f-41ce-b83c-87618cca1470 req-2529caa9-85e9-4fff-87b4-9613cefc1ead service nova] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1131.211108] env[65738]: INFO networking_nsxv3.common.synchronization [req-d221aa57-a04f-41ce-b83c-87618cca1470 req-2529caa9-85e9-4fff-87b4-9613cefc1ead service nova] Enqueued Resource ID: 8d6d50b6-ea3e-4ec3-a60b-104c696657dc with Priority: HIGHEST for action port [ 1131.211283] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_rules [ 1131.211415] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1131.211529] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6d50b6-ea3e-4ec3-a60b-104c696657dc with Priority: HIGHEST for action port [ 1131.211831] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.211949] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.212234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.212400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.212483] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.213750] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.213982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.214041] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.214221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.214374] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.214468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.214530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.214655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.214736] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.214825] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.216403] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.216403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.216403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.216403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.216403] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d50b6-ea3e-4ec3-a60b-104c696657dc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.286225] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.715086] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.715086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.716932] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.717916] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d6d50b6-ea3e-4ec3-a60b-104c696657dc with status ACTIVE [ 1131.718260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.718388] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.718457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.718667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.718759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.718933] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.719040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.719128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.719370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.719370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.719552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.719667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.719731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.719872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.719982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.720065] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d6d50b6-ea3e-4ec3-a60b-104c696657dc is going to be updated. [ 1131.741966] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.742135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.742203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.742526] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.742623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.742781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d6d50b6-ea3e-4ec3-a60b-104c696657dc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.788404] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.046655] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1132.047458] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.218963] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.291399] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.291614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.291732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.292082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.292207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.292347] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1132.346257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.346550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.346550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.346803] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.347249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.358513] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1132.638023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b in Status: SUCCESS [ 1132.638231] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b deletion is rescheduled due to dependency. [ 1132.638351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.726024] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.726024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.726024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.726024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.726024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.726024] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1c642a-c375-4b06-8293-de7939b50479 is going to be created. [ 1132.752449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.752595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.752662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.752995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.753109] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.763507] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: UNINITIALIZED for 2s [ 1133.153280] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.153504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.153634] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.154055] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.154325] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.154487] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.154607] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.154827] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.155064] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.155286] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.155398] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.155507] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.155685] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.155729] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.155806] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.155936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.176713] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.176946] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.177142] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.177322] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.177652] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b711d97d-70be-492a-a9a2-f432874c1347 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.177815] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.177934] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.178257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.178397] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b711d97d-70be-492a-a9a2-f432874c1347',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.682873] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.684144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.684144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.684144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.684144] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.684144] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b711d97d-70be-492a-a9a2-f432874c1347 not found, creating... [ 1133.684393] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.684465] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.684605] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.684862] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.685422] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.685422] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.685581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.685746] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.685993] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.686191] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.686374] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b711d97d-70be-492a-a9a2-f432874c1347 is going to be created. [ 1133.717158] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.717450] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.717568] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.717848] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.718090] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.718318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.370636] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1134.370884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.390645] env[65738]: INFO networking_nsxv3.common.synchronization [req-ef3284ab-e3c2-4073-bd7f-911e9583eaf1 req-01ae97da-1ea9-46cc-98c8-9e5fd9cbe614 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1134.390845] env[65738]: INFO networking_nsxv3.common.synchronization [req-ef3284ab-e3c2-4073-bd7f-911e9583eaf1 req-01ae97da-1ea9-46cc-98c8-9e5fd9cbe614 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1134.390981] env[65738]: INFO networking_nsxv3.common.synchronization [req-ef3284ab-e3c2-4073-bd7f-911e9583eaf1 req-01ae97da-1ea9-46cc-98c8-9e5fd9cbe614 service nova] Enqueued Resource ID: b711d97d-70be-492a-a9a2-f432874c1347 with Priority: HIGHEST for action port [ 1134.391529] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1134.391663] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1134.391760] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b711d97d-70be-492a-a9a2-f432874c1347 with Priority: HIGHEST for action port [ 1134.392269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.392461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.392551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.392874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.392874] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.393773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.394623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.394623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.394623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.394623] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.394623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.394623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.394887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.394916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.395028] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.396119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b711d97d-70be-492a-a9a2-f432874c1347 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.396528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.396528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.396699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.396775] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b711d97d-70be-492a-a9a2-f432874c1347',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.779840] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: SUCCESS [ 1134.779840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.780268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.780268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.780332] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.780442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.780552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.780719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.781625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.781625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.781625] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.898796] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.899630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.899630] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.900385] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b711d97d-70be-492a-a9a2-f432874c1347 with status ACTIVE [ 1134.900637] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.900769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.900829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.901074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.901231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.901474] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.901630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.901717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.903733] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.903733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.903733] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b711d97d-70be-492a-a9a2-f432874c1347 is going to be updated. [ 1134.926154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.926415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.926415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.926676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.926834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.927016] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b711d97d-70be-492a-a9a2-f432874c1347" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.283164] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.406498] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.786406] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac1c642a-c375-4b06-8293-de7939b50479: rpc.has_security_group_logging(os_id): False [ 1135.808228] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.808404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.808472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.808819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.808819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.809053] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.809229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.809229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.809447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.809447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.809447] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1c642a-c375-4b06-8293-de7939b50479 is going to be created. [ 1135.883535] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.883799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.883799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.883952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.884161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.895912] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: IN_PROGRESS for 2s [ 1135.907565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.907758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.907805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.908072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.908190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.908302] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1135.941983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.941983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.941983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.941983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.941983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.953257] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1136.055986] env[65738]: INFO networking_nsxv3.common.synchronization [None req-933a9a99-97fc-492c-89bd-86d3ca5a0721 None None] Enqueued Resource ID: e2959198-2cbe-431f-86d8-afcec03c28f8 with Priority: HIGHEST for action port [ 1136.056799] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2959198-2cbe-431f-86d8-afcec03c28f8 with Priority: HIGHEST for action port [ 1136.057224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2959198-2cbe-431f-86d8-afcec03c28f8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.057382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2959198-2cbe-431f-86d8-afcec03c28f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.057472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2959198-2cbe-431f-86d8-afcec03c28f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.057801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2959198-2cbe-431f-86d8-afcec03c28f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.057909] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2959198-2cbe-431f-86d8-afcec03c28f8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.563537] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2959198-2cbe-431f-86d8-afcec03c28f8 [ 1136.563537] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.563537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.563537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.563537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.563537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.563537] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2959198-2cbe-431f-86d8-afcec03c28f8 already deleted. [ 1136.563537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2959198-2cbe-431f-86d8-afcec03c28f8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.909446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: SUCCESS [ 1137.909818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.962781] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1137.963018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.963171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.963381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.963576] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.963690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.963785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.963898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.963976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.964071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.964158] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.360953] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3f691750-13b2-4a03-a8bd-21705bed1b1c None None] Enqueued Resource ID: e3c62267-f27d-4036-8e4b-1ebf73df3bba with Priority: HIGHEST for action port [ 1138.361675] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c62267-f27d-4036-8e4b-1ebf73df3bba with Priority: HIGHEST for action port [ 1138.361914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c62267-f27d-4036-8e4b-1ebf73df3bba taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.362035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c62267-f27d-4036-8e4b-1ebf73df3bba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.362102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c62267-f27d-4036-8e4b-1ebf73df3bba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.362352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c62267-f27d-4036-8e4b-1ebf73df3bba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.362440] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c62267-f27d-4036-8e4b-1ebf73df3bba',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.466776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.466776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.466776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.467114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.467114] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.467194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.467225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.467370] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.467460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.467547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.467704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.467799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.467831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.467989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.468144] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.468261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.468298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.468446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.468541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.468627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.468745] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.864079] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3c62267-f27d-4036-8e4b-1ebf73df3bba [ 1138.864271] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.864406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.864469] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.864759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.864846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.865029] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3c62267-f27d-4036-8e4b-1ebf73df3bba already deleted. [ 1138.865136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c62267-f27d-4036-8e4b-1ebf73df3bba" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.971413] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1138.991798] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.991935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.992019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.992241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.992335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.992566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.992670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.992732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.992882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.992958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.993168] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.993253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.993314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.993450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.993524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.993723] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.993815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.993874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.994015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.994104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.994189] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1139.063413] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.063607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.063673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.063853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.064011] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.078388] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1141.053966] env[65738]: INFO networking_nsxv3.common.synchronization [req-ecce9770-9d41-4209-b7d6-027e792602b8 req-e224dec3-ca0d-4035-9dd8-961834c7614b tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1141.055027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1141.055146] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.055275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.055389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.055619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.055824] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.055951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.056037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.057159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.057159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.057159] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.098673] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1141.098889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.407840] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.408058] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.408187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.408462] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.408723] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.408908] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.409030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.409339] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.409490] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.409697] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.409807] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.409912] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.410051] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.410159] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.410254] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.410383] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.431246] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.431430] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.431553] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.431731] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-829" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.432068] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.432246] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.432365] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.432684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.432844] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b8e12b7-99de-4e30-9adb-0e48a1017fd8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.558571] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.935553] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.935866] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.936076] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.936292] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.936465] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.936592] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 not found, creating... [ 1141.936872] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.937056] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.937186] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.937419] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.937561] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.937859] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.938232] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.938494] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.938774] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.938953] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.939181] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 is going to be created. [ 1141.960176] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.960416] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.960621] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.960893] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.961136] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.961378] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.063780] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.567022] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.567022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.567022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.567446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.567446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.567446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1142.597053] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.597053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.597053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.597374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.597569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.608499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1142.692279] env[65738]: INFO networking_nsxv3.common.synchronization [req-ecce9770-9d41-4209-b7d6-027e792602b8 req-0259199c-26a7-4e86-b129-52b797749f63 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1142.692501] env[65738]: INFO networking_nsxv3.common.synchronization [req-ecce9770-9d41-4209-b7d6-027e792602b8 req-0259199c-26a7-4e86-b129-52b797749f63 service nova] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1142.692674] env[65738]: INFO networking_nsxv3.common.synchronization [req-ecce9770-9d41-4209-b7d6-027e792602b8 req-0259199c-26a7-4e86-b129-52b797749f63 service nova] Enqueued Resource ID: 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 with Priority: HIGHEST for action port [ 1142.693246] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_rules [ 1142.693404] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1142.693520] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 with Priority: HIGHEST for action port [ 1142.693824] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.693963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.694128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.694298] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.694394] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.695628] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.695628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.695832] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.695962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.696052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.696219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.696315] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b8e12b7-99de-4e30-9adb-0e48a1017fd8',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.199059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.199434] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.199489] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 with status ACTIVE [ 1143.199711] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.199854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.199932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.200203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.200396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.200567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.200711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.200761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.200929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.201044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.201274] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.201376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.201483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.201854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.201854] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.201945] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b8e12b7-99de-4e30-9adb-0e48a1017fd8 is going to be updated. [ 1143.228894] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.229090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.229171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.229431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.229606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.229849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b8e12b7-99de-4e30-9adb-0e48a1017fd8" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.438125] env[65738]: INFO networking_nsxv3.common.synchronization [req-52ac4e99-ac7d-44ee-b0bd-054886b777e8 req-b7093a1c-36c3-461b-a2c4-a2d25b8619ef tempest-ServerMetadataNegativeTestJSON-1652872599 tempest-ServerMetadataNegativeTestJSON-1652872599-project-member] Enqueued Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1143.438125] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1143.438436] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.438550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.438682] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.439018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.439251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.439406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.439492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.439709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.439880] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.439971] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.749568] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.749819] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.749951] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.750292] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.750583] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.750746] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.750869] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.751141] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.751293] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.751562] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.751678] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.751809] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.751915] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.752038] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.752147] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.752283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.773764] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.773941] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.774256] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.774371] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-799" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.774640] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-aae88a97-0e19-4363-ac62-658559457663 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.774794] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.774915] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.775263] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.775410] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae88a97-0e19-4363-ac62-658559457663',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.943970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.943970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.943970] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 already deleted. [ 1143.943970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.277919] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.278549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.278549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.279114] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.279317] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.279632] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port aae88a97-0e19-4363-ac62-658559457663 not found, creating... [ 1144.280299] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.280775] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.280967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.281318] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.281555] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.281916] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.282102] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.282223] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.282453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.282593] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.282840] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: aae88a97-0e19-4363-ac62-658559457663 is going to be created. [ 1144.313640] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.313847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.313887] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.314185] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.314417] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.314652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.619954] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1144.620210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.620376] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.620634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.620857] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.621024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.621097] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.621257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.621338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.621437] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.055764] env[65738]: INFO networking_nsxv3.common.synchronization [req-52ac4e99-ac7d-44ee-b0bd-054886b777e8 req-4a56aad4-41f5-46b3-937e-9719a44c4c2a service nova] Enqueued Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_rules [ 1145.055982] env[65738]: INFO networking_nsxv3.common.synchronization [req-52ac4e99-ac7d-44ee-b0bd-054886b777e8 req-4a56aad4-41f5-46b3-937e-9719a44c4c2a service nova] Enqueued Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1145.057314] env[65738]: INFO networking_nsxv3.common.synchronization [req-52ac4e99-ac7d-44ee-b0bd-054886b777e8 req-4a56aad4-41f5-46b3-937e-9719a44c4c2a service nova] Enqueued Resource ID: aae88a97-0e19-4363-ac62-658559457663 with Priority: HIGHEST for action port [ 1145.057314] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_rules [ 1145.057314] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1145.057314] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae88a97-0e19-4363-ac62-658559457663 with Priority: HIGHEST for action port [ 1145.060052] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.060347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.060347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.062168] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.062298] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.063809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.063809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.063809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.063973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.064127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.064330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.064330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.064491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.064553] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.064600] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.069102] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-aae88a97-0e19-4363-ac62-658559457663 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.069403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.069493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.069792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.069879] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae88a97-0e19-4363-ac62-658559457663',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.124112] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.539602] env[65738]: INFO networking_nsxv3.common.synchronization [req-a588f03f-4f77-445a-b313-15c2fca76622 req-f27f6d73-17c9-4e12-b1e5-b36d7345bf61 tempest-ServersV294TestFqdnHostnames-941903243 tempest-ServersV294TestFqdnHostnames-941903243-project-member] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 1145.540227] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGHEST for action security_group_members [ 1145.540606] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.540725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.540851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.541184] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.541281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.541666] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.541830] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.569351] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.573150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aae88a97-0e19-4363-ac62-658559457663 with status ACTIVE [ 1145.573435] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.573606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.573727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.573993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.573993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.574143] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.574240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.574297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.574449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.574504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.574687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.574775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.574835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.574967] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.575404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.575404] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aae88a97-0e19-4363-ac62-658559457663 is going to be updated. [ 1145.576297] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.576394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.601040] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.601040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.601040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.601330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.601406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.601565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aae88a97-0e19-4363-ac62-658559457663" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.628684] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.044075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.044268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.044337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.044557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.044654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.044863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.044959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.045066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.045182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.045258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.045345] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b is going to be updated. [ 1146.072470] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.074477] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.074477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.074477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.074681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.074790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.084767] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: IN_PROGRESS for 2s [ 1146.133704] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.133910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.133982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.134212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.134305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.134415] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1146.172410] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.172410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.172410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.172410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.172676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.184921] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1146.577358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.577707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.577707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.578212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.578212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.578212] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 is going to be created. [ 1146.608512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.608512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.608512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.608748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.608779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.619592] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: UNINITIALIZED for 2s [ 1146.663250] env[65738]: INFO networking_nsxv3.common.synchronization [req-51cba25a-d0a8-4bbb-88e7-13e8175ffd87 req-1ef3b32c-793e-4f21-b04e-ca043fbf61ef tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1146.663443] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1146.663986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.664428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.664697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.667105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.667105] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.667105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.667105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.667105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.667105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.667105] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.170696] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.674209] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.691628] env[65738]: INFO networking_nsxv3.common.synchronization [None req-8bcd2e91-c46e-4044-8bc9-c55fb3846832 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1147.698375] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1147.698375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.698375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.096492] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b in Status: SUCCESS [ 1148.096702] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b deletion is rescheduled due to dependency. [ 1148.096822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.176611] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.176886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.176954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.177212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.177339] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.177463] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1148.195283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1148.195533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.195676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.195900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.196113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.196276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.196355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.196534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.196621] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.196708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.196801] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.208350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.208785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.208988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.209296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.209535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.221152] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1148.630167] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: SUCCESS [ 1148.630385] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.630594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.630838] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.631106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.631254] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.631348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.631514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.631601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.631697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.631806] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.699677] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.699996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.699996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.700144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.700320] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.700493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.700571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.700734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.700819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.700907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.701078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.701169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.701230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.701369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.701544] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.701622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.701676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.701809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.701884] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.701965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.702061] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.133860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.134181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.134181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.134311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.134488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.134597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.134638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.134797] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.134907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.134964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.135130] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.135221] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.135279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.135411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.135537] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.135619] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.135673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.135809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.135863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.135943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.136050] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.207085] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbeb4a5d-7195-44c9-b3bc-982306062ac6: rpc.has_security_group_logging(os_id): False [ 1149.226290] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.226569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.226569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.226790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.226877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.227131] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.227261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.227340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.227473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.227562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.227752] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.227987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.227987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.228368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.228368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.228647] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.228647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.228647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.228852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.228852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.228938] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1149.297566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.297798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.297798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.297986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.298152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.319105] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1149.639053] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc778f57-9a35-46ae-9597-a5e999c47fd9: rpc.has_security_group_logging(os_id): False [ 1149.660236] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.660516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.660631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.660871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.660979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.661269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.661397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.661557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.661738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.661965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.662243] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.662368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.662461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.662645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.662742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.662996] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.663123] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.663186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.663364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.663515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.663557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 is going to be created. [ 1149.725605] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.725605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.726461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.726461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.726461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.738074] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: IN_PROGRESS for 2s [ 1150.232806] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1150.233050] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.233219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.233552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.233793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.233917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.233986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.234161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.234241] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.234337] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.738187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.738187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.738187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.738799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.738799] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1150.775193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.775411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.775457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.775776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.776017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.786686] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1150.952815] env[65738]: INFO networking_nsxv3.common.synchronization [req-fe71651d-4688-47e5-9715-6e741fa1259d req-ff25acef-aa98-4e3c-8a39-4049e0f2b353 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1150.953428] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGHEST for action security_group_members [ 1150.954194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.954194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.954194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.954393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.954393] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.954471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.954542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.954734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.954835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.954935] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.369056] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1151.370633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.458091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.458091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.458091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.458091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.458091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.458413] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.458569] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.458641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.458885] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.459029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.459145] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 is going to be updated. [ 1151.491646] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.491833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.491877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.492098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.492815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.501827] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: IN_PROGRESS for 2s [ 1151.524547] env[65738]: INFO networking_nsxv3.common.synchronization [req-6614e76c-afb8-4a3e-b0f2-5e6a1e073eff req-c3dbf082-32ae-45b1-b7e0-be35754f25ce tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1151.524818] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1151.525157] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.525283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.525352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.525562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.525724] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.525865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.525938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.526110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.526229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.526328] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.751407] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: SUCCESS [ 1151.751738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.028571] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.028735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.028875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.029194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.029457] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.029720] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.029899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.029999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.030276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.030472] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.030551] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1152.064219] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.064463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.064539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.064809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.064965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.074748] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1152.798277] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1152.798643] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 deletion is rescheduled due to dependency. [ 1152.798643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.515669] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da85289d-08d2-4040-ba9b-31d7eea34c68 in Status: SUCCESS [ 1153.515669] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 deletion is rescheduled due to dependency. [ 1153.515669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.086133] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1154.086392] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d deletion is rescheduled due to dependency. [ 1154.086445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.147360] env[65738]: INFO networking_nsxv3.common.synchronization [req-917e40f3-f1d7-494e-9770-207c19189150 req-a910b2b4-2181-4ee1-a32e-872fd1119d6a tempest-ServerMetadataNegativeTestJSON-1652872599 tempest-ServerMetadataNegativeTestJSON-1652872599-project-member] Enqueued Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1156.147903] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGHEST for action security_group_members [ 1156.148634] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.148634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.148634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.148634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.148977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.148977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.148977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.149259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.149366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.149477] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.266579] env[65738]: INFO networking_nsxv3.common.synchronization [None req-fefd8241-3f7b-4a34-b470-a1701cdea943 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1156.267181] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1156.268142] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.268142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.268142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.268142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.268142] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.349938] env[65738]: INFO networking_nsxv3.common.synchronization [req-65d918c4-79f2-45a5-9adb-4cf85a4cda64 req-ca7d6ac3-35bc-47d9-98dc-bf29b73f0c6a tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1156.351108] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1156.351234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.351365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.351420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.351657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.352732] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.352950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.353034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.353460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.353460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.353460] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.396979] env[65738]: INFO networking_nsxv3.common.synchronization [None req-c70969d9-f773-4f58-9a31-7117b1b8db38 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1156.397618] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1156.397772] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.398760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.652409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.652409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.652409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.652409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.652752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.653088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.653318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.653614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.656324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.656324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.656324] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 is going to be updated. [ 1156.683797] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.684120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.684288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.684589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.684837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.694721] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: IN_PROGRESS for 2s [ 1156.790716] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.790954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.790954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.791171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.791263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.791331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 already deleted. [ 1156.791409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.792686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.792686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.792686] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.855498] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.311552] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.311862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.311862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.311862] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.312036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.312036] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 already deleted. [ 1157.312129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.357650] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.861595] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.861792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.861927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.862282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.862404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.862546] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1157.894841] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.895384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.895522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.895881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.896083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.907777] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1158.707640] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 in Status: SUCCESS [ 1158.707905] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 deletion is rescheduled due to dependency. [ 1158.707945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.917978] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1159.918342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.398119] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.398493] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1164.967470] env[65738]: INFO networking_nsxv3.common.synchronization [req-3a4f7db2-dc59-421c-8565-afc2790d7d90 req-2db29633-4c08-487c-b3e4-d13f44f4031c tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1164.968123] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1164.968488] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.968613] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.968694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.968915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.969116] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.969190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.969251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.969422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.969506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.969610] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.296649] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.296870] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.296974] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.297261] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.297526] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.297736] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.297790] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.298016] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.298164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.298375] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.298860] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.298860] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.298860] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.298860] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.299048] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.299048] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.320901] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.321210] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.321281] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.321474] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.321795] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.321984] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.322178] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.322509] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.322654] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71c001f-eb70-44ff-8b61-05f1f0ed10cb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.472200] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.472396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.472439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.472640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.472735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.472942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.473100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.473165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.473319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.473399] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.473499] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1165.500516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.500742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.500742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.500932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.501094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.514192] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1165.825447] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.825691] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.825816] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.826108] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.826264] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.826417] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b71c001f-eb70-44ff-8b61-05f1f0ed10cb not found, creating... [ 1165.826673] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.826829] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.826946] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.827177] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.827309] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.827616] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.827789] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.827908] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.828131] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.828282] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.828434] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb is going to be created. [ 1165.849461] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.849662] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.849785] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.850066] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.850296] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.850589] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.003044] env[65738]: INFO networking_nsxv3.common.synchronization [req-3a4f7db2-dc59-421c-8565-afc2790d7d90 req-5f7fc139-9158-4f53-966a-ef8bb799e00d service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1167.003432] env[65738]: INFO networking_nsxv3.common.synchronization [req-3a4f7db2-dc59-421c-8565-afc2790d7d90 req-5f7fc139-9158-4f53-966a-ef8bb799e00d service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1167.003432] env[65738]: INFO networking_nsxv3.common.synchronization [req-3a4f7db2-dc59-421c-8565-afc2790d7d90 req-5f7fc139-9158-4f53-966a-ef8bb799e00d service nova] Enqueued Resource ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb with Priority: HIGHEST for action port [ 1167.004032] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1167.004123] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1167.004223] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb with Priority: HIGHEST for action port [ 1167.004515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.004636] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.004701] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.004905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.004999] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.005921] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.005985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.006187] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.006290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.006355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.006554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.006643] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71c001f-eb70-44ff-8b61-05f1f0ed10cb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.509093] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.509093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.511543] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b71c001f-eb70-44ff-8b61-05f1f0ed10cb with status ACTIVE [ 1167.511795] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.511953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.512083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.512310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.512432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.512615] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.512769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.512839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.512941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.513021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.513200] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.513288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.514033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.514033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.514033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.514033] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb is going to be updated. [ 1167.528331] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1167.528511] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d deletion is rescheduled due to dependency. [ 1167.528652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.528834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.528992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.529192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.529302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.529365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.529509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.529586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.529681] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.538744] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.538919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.538996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.539154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.539287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.539438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.031985] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.534744] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.037375] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.037767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.037767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.037842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.037924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.038081] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1169.069918] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.070164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.070164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.070400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.070544] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.081784] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1169.104246] env[65738]: INFO networking_nsxv3.common.synchronization [req-18a8a8b6-ead0-4efd-bdf5-52a498f37428 req-b097d5d5-673a-43e3-8019-2119301e7386 tempest-AttachVolumeTestJSON-1643705349 tempest-AttachVolumeTestJSON-1643705349-project-member] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1169.104872] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGHEST for action security_group_members [ 1169.105210] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.105340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.105407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.105608] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.105761] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.105857] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.105919] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.106070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.106156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.106245] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.608759] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.608922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.608981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.609225] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.609320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.609551] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.609660] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.609730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.610015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.610015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.610124] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc is going to be updated. [ 1169.639267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.639448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.639489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.639679] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.639820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.648581] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: IN_PROGRESS for 2s [ 1170.217224] env[65738]: INFO networking_nsxv3.common.synchronization [req-5255c823-fed3-4721-9f37-990565e39f21 req-ce8492cf-b28f-4d5d-b6e0-38077e68b3c2 tempest-ServersTestJSON-1010368636 tempest-ServersTestJSON-1010368636-project-member] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1170.217739] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGHEST for action security_group_members [ 1170.218068] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.221566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.221566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.221566] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.497133] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24fd8a4-1b80-4b94-969a-cd516202d8b3 req-f05b0b22-942e-473a-859c-4715889e77ea tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1170.497133] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1170.497133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.497133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.497133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.497746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.498080] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.498439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.498983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.499301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.499516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.500058] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.727078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.727260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.727327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.727556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.727650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.727850] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.727972] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.728024] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.728159] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.728240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.728330] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be updated. [ 1170.758344] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.758597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.758656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.758959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.759060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.773716] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: IN_PROGRESS for 2s [ 1170.808697] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.808910] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.809033] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.809293] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.809583] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.809818] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.809944] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.810431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.810616] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.810834] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.810946] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.811067] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.811186] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.811306] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.811474] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.811534] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.839305] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.839539] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.839677] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.839854] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.840433] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.840433] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.840653] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.840867] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.841012] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8042d547-c2e3-46ee-ab42-8fb8baa4a66d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.003237] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.003430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.003430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.003626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.003715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.003922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.004021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.004086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.004228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.004300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.004386] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 already deleted. [ 1171.005036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.092364] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1171.092588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.092782] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.093021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.093201] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.093315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.093422] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.093576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.093690] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.093779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.093867] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.343932] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.343932] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.344330] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.344330] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.344505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.344505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 8042d547-c2e3-46ee-ab42-8fb8baa4a66d not found, creating... [ 1171.344505] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.344505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.344505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.345385] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.345471] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.345852] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.346090] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.346250] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.346506] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.346665] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.346834] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 8042d547-c2e3-46ee-ab42-8fb8baa4a66d is going to be created. [ 1171.368102] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.368102] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.368102] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.368102] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.368388] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.368500] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.596893] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.662779] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc in Status: SUCCESS [ 1171.663128] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc deletion is rescheduled due to dependency. [ 1171.663384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.098481] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b02ac3e-b94a-42ba-b911-23fb0744001d: rpc.has_security_group_logging(os_id): False [ 1172.117698] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24fd8a4-1b80-4b94-969a-cd516202d8b3 req-d0292a0d-309a-45fa-909a-10c042f396d3 service nova] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1172.117970] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24fd8a4-1b80-4b94-969a-cd516202d8b3 req-d0292a0d-309a-45fa-909a-10c042f396d3 service nova] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1172.118187] env[65738]: INFO networking_nsxv3.common.synchronization [req-a24fd8a4-1b80-4b94-969a-cd516202d8b3 req-d0292a0d-309a-45fa-909a-10c042f396d3 service nova] Enqueued Resource ID: 8042d547-c2e3-46ee-ab42-8fb8baa4a66d with Priority: HIGHEST for action port [ 1172.119286] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.119404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.119687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.119777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.120041] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.120155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.120246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.120445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.120540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.120632] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1172.122182] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1172.122324] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1172.122420] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8042d547-c2e3-46ee-ab42-8fb8baa4a66d with Priority: HIGHEST for action port [ 1172.122726] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.122850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.122904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.123095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.123180] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.124430] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.124430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.124430] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.124556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.124616] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.124702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.124761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.125021] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.125127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.125225] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.126354] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.126354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.126354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.126492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.126608] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8042d547-c2e3-46ee-ab42-8fb8baa4a66d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.202184] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.202400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.202400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.202999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.202999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.217928] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1172.628786] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8042d547-c2e3-46ee-ab42-8fb8baa4a66d with status ACTIVE [ 1172.629094] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.629252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.629324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.629540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.629630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.629803] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.629923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.629962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.630113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.630188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.630412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.630503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.630565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.630731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.630806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.631033] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8042d547-c2e3-46ee-ab42-8fb8baa4a66d is going to be updated. [ 1172.632045] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.632161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.632317] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.655548] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.655712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.655816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.656072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.656236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.656408] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8042d547-c2e3-46ee-ab42-8fb8baa4a66d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.788283] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 in Status: SUCCESS [ 1172.788488] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 deletion is rescheduled due to dependency. [ 1172.788617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.134879] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.637809] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.638127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.638127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.638297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.638390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.638505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be created. [ 1173.666682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.666811] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.666881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.667816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.667816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.679290] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: UNINITIALIZED for 2s [ 1174.235769] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1174.235993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.689821] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1175.689821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.689821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.689821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.690260] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.690260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.690260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.690489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.690489] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.690671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.690671] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.193463] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.697843] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8871243-0535-44e9-b0bd-b3fef12e1c90: rpc.has_security_group_logging(os_id): False [ 1176.716979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.716979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.716979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.716979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.716979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.716979] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.716979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.717350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.717350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.717350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.717505] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be created. [ 1176.780977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.781160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.781204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.781416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.781630] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.793854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1177.123958] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.124128] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1178.809014] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1178.809563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.124858] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.125160] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1183.100135] env[65738]: INFO networking_nsxv3.common.synchronization [req-5ed1d1d6-8ad4-4487-af4d-6a235acb7804 req-0302925d-1e63-4b8f-830b-76ba3bc136e4 tempest-AttachVolumeNegativeTest-2010596046 tempest-AttachVolumeNegativeTest-2010596046-project-member] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1183.100772] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGHEST for action security_group_members [ 1183.101106] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.101232] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.101299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.101503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.101665] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.101763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.101843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.101968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.102066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.102162] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.604074] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.604498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.604622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.605199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.605309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.605666] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.605783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.605865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.606142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.606231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.606653] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 is going to be updated. [ 1183.642913] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.643295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.643295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.643557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.643752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.657583] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: IN_PROGRESS for 2s [ 1185.288980] env[65738]: INFO networking_nsxv3.common.synchronization [req-cae65292-c8eb-4931-8f0b-d9bb6cfde279 req-e885f87d-7c3c-40ef-9c35-34300001a7fa tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1185.289602] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1185.290824] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.290824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.290824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.291051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.291273] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.291396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.291831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.292054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.292166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.292267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.669862] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 in Status: SUCCESS [ 1185.670094] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 deletion is rescheduled due to dependency. [ 1185.670445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.722478] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.722711] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.722861] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.723195] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.723505] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.723702] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.723833] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.724088] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.724257] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.724476] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.724600] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.724709] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.724813] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.724923] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.725038] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.725175] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.745115] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.745339] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.745453] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.745651] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.745995] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-6a66a869-758d-437e-927e-f5b6635b3706 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.746207] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.746333] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.746663] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.746801] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a66a869-758d-437e-927e-f5b6635b3706',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.794974] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.249786] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.250034] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.250113] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.250418] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.250581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.250742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 6a66a869-758d-437e-927e-f5b6635b3706 not found, creating... [ 1186.251014] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.251184] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.251303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.251520] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.251652] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.251930] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.252095] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.252210] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.252409] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.252540] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.252680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 6a66a869-758d-437e-927e-f5b6635b3706 is going to be created. [ 1186.276355] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.276847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.276976] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.277279] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.277566] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.277935] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.296652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.799235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.799558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.799558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.799648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.799735] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.799835] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be updated. [ 1186.826970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.827333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.827333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.827456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.827539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.836625] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1186.991179] env[65738]: INFO networking_nsxv3.common.synchronization [req-cae65292-c8eb-4931-8f0b-d9bb6cfde279 req-052a14e4-4f52-491d-8bb8-17e7e8eb00fd service nova] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1186.991550] env[65738]: INFO networking_nsxv3.common.synchronization [req-cae65292-c8eb-4931-8f0b-d9bb6cfde279 req-052a14e4-4f52-491d-8bb8-17e7e8eb00fd service nova] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1186.991550] env[65738]: INFO networking_nsxv3.common.synchronization [req-cae65292-c8eb-4931-8f0b-d9bb6cfde279 req-052a14e4-4f52-491d-8bb8-17e7e8eb00fd service nova] Enqueued Resource ID: 6a66a869-758d-437e-927e-f5b6635b3706 with Priority: HIGHEST for action port [ 1186.992176] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_rules [ 1186.992365] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1186.992483] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a66a869-758d-437e-927e-f5b6635b3706 with Priority: HIGHEST for action port [ 1186.992818] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.992963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.993051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.993256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.993342] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.995439] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.995439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.995439] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a66a869-758d-437e-927e-f5b6635b3706 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.995439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.995439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.995439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.995439] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a66a869-758d-437e-927e-f5b6635b3706',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.496032] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.496451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.497538] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a66a869-758d-437e-927e-f5b6635b3706 with status ACTIVE [ 1187.497753] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.497893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.497960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.498186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.498292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.498710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.498710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.498710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.498832] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.498908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.499087] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.499183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.499243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.499389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.499456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.499545] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a66a869-758d-437e-927e-f5b6635b3706 is going to be updated. [ 1187.527990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.528184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.528228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.528579] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.528731] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.528899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a66a869-758d-437e-927e-f5b6635b3706" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.850528] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1188.850528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.850528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.850528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.850528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.850941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.850941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.850941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.850941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.851074] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.354775] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.857404] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.360515] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.360717] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.360762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.361046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.361174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.361287] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be updated. [ 1190.389951] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.390186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.390284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.390700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.390855] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.400170] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1191.486940] env[65738]: INFO networking_nsxv3.common.synchronization [req-10f399b3-a881-4f15-aafd-e98aa562a29d req-68fef2d4-1109-4130-b159-eb1f432d44b5 tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1191.487649] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1191.488594] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.488594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.488594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.488594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.488873] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.488873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.488873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.488985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.489040] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.489136] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.991485] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.411915] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1192.412164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.412333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.412551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.412765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.412888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.412955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.413124] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.413205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.413288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.413380] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.494215] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.915177] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.997154] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.997377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.997449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.997713] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.997808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.997914] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be updated. [ 1193.027969] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.028172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.028215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.028442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.028591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.039170] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 1193.416909] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8871243-0535-44e9-b0bd-b3fef12e1c90: rpc.has_security_group_logging(os_id): False [ 1193.434990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.436140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.436140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.436140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.436140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.436140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.436419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.436419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.436485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.436539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.436637] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be updated. [ 1193.496773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.497137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.497137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.497391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.497618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.512395] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1195.049849] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 1195.050249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.526136] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1195.526292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.905158] env[65738]: INFO networking_nsxv3.common.synchronization [None req-084fb97d-a324-41bc-9a79-833497fc2121 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1195.907216] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1195.907216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.907216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.907216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.907216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.907216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.907436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.907436] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.908400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.908400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.908400] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.412069] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.412069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.412069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.412069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.412498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.412498] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.412498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.412498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.412645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.412673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.412825] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1196.443288] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.443512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.443512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.443753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.443816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.454333] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1198.468343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1198.468748] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 deletion is rescheduled due to dependency. [ 1198.468748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.907420] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.907677] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.909036] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.909036] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1206.883550] env[65738]: INFO networking_nsxv3.common.synchronization [req-3d17a67f-0504-4620-a7a8-a40779a19861 req-d45869c3-11a3-4eb8-a8c9-12edbd02306f tempest-ServerActionsTestOtherA-1046049256 tempest-ServerActionsTestOtherA-1046049256-project-member] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1206.884154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGHEST for action security_group_members [ 1206.884582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.884582] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.884689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.885038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.885038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.885446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.885446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.885596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.886415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.886415] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.388733] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.389181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.389181] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.389300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.389418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.389674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.389794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.389865] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.390030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.390112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.390204] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be updated. [ 1207.418862] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.419102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.419102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.419390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.419540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.430550] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: IN_PROGRESS for 2s [ 1209.442638] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 in Status: SUCCESS [ 1209.443028] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 deletion is rescheduled due to dependency. [ 1209.443028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.885769] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.886106] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1212.672921] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.673140] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.673184] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.673452] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.673720] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.673874] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.673989] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.674216] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.674362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.674582] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.674688] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.674786] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.674893] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.675000] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.675112] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.675264] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.695251] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.695416] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.695607] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.695771] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.696104] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.696287] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.696431] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.696799] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.696946] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51fe28d-0aaf-4b51-b6e5-20bcdf779680',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.200131] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.200539] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.200539] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.200918] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.201086] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.201249] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b51fe28d-0aaf-4b51-b6e5-20bcdf779680 not found, creating... [ 1213.201511] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.201667] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.201781] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.202009] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.202156] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.202439] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.202592] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.202705] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.202940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.203080] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.203221] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 is going to be created. [ 1213.224578] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.224799] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.224925] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.225229] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.225465] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.225692] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.975691] env[65738]: INFO networking_nsxv3.common.synchronization [req-5551659e-1809-413e-bc1a-ff3e8fba6f1c req-00e3b942-ea15-4ab4-bf76-68c53966f919 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1213.975894] env[65738]: INFO networking_nsxv3.common.synchronization [req-5551659e-1809-413e-bc1a-ff3e8fba6f1c req-00e3b942-ea15-4ab4-bf76-68c53966f919 service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1213.976046] env[65738]: INFO networking_nsxv3.common.synchronization [req-5551659e-1809-413e-bc1a-ff3e8fba6f1c req-00e3b942-ea15-4ab4-bf76-68c53966f919 service nova] Enqueued Resource ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with Priority: HIGHEST for action port [ 1213.976623] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1213.976756] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1213.976858] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with Priority: HIGHEST for action port [ 1213.977350] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.977519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.977651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.977901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.978102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.979859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.980178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.980503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.980784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.981157] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.981493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.981615] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.982035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.982112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.982570] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.984013] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.984316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.984429] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.984623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.984749] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51fe28d-0aaf-4b51-b6e5-20bcdf779680',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.486653] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.486950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.489231] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.490641] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with status ACTIVE [ 1214.490847] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.490965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.491044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.491249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.491337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.491501] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.491985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.491985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.492087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.492125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.492303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.492401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.492453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.492585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.492656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.492744] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 is going to be updated. [ 1214.513235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.513400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.513447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.513684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.513822] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.513964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.946768] env[65738]: INFO networking_nsxv3.common.synchronization [None req-dfa6b998-9604-4900-85a1-ca19abce4c76 None None] Enqueued Resource ID: e6565f29-9aa0-4624-b59d-2eb09da203e7 with Priority: HIGHEST for action port [ 1214.947323] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6565f29-9aa0-4624-b59d-2eb09da203e7 with Priority: HIGHEST for action port [ 1214.947651] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6565f29-9aa0-4624-b59d-2eb09da203e7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.947872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6565f29-9aa0-4624-b59d-2eb09da203e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.947872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6565f29-9aa0-4624-b59d-2eb09da203e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.948167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6565f29-9aa0-4624-b59d-2eb09da203e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.948167] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6565f29-9aa0-4624-b59d-2eb09da203e7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.994340] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.450657] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6565f29-9aa0-4624-b59d-2eb09da203e7 [ 1215.450898] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.451044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.451113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.451311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.451396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.451493] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6565f29-9aa0-4624-b59d-2eb09da203e7 already deleted. [ 1215.451568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6565f29-9aa0-4624-b59d-2eb09da203e7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.496984] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.497337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.497337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.497712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.497809] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.497915] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1215.528722] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.528913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.528913] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.529086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.529210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.538016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1216.985124] env[65738]: INFO networking_nsxv3.common.synchronization [None req-1055bbdd-f852-46f0-92e2-17fc6a097261 None None] Enqueued Resource ID: 97b2614f-6e1d-48b9-900f-b1b5d4306361 with Priority: HIGHEST for action port [ 1216.985711] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97b2614f-6e1d-48b9-900f-b1b5d4306361 with Priority: HIGHEST for action port [ 1216.986104] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-97b2614f-6e1d-48b9-900f-b1b5d4306361 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.986216] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97b2614f-6e1d-48b9-900f-b1b5d4306361" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.986288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97b2614f-6e1d-48b9-900f-b1b5d4306361" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.986597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97b2614f-6e1d-48b9-900f-b1b5d4306361" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.986697] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97b2614f-6e1d-48b9-900f-b1b5d4306361',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.489249] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97b2614f-6e1d-48b9-900f-b1b5d4306361 [ 1217.489623] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.489834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.490069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.490294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.490440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.490592] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97b2614f-6e1d-48b9-900f-b1b5d4306361 already deleted. [ 1217.490726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97b2614f-6e1d-48b9-900f-b1b5d4306361" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.550276] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1217.550714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.550867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.551162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.551363] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.551504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.551577] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.551743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.551821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.551906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.551996] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.055155] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.055567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.055567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.055750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.055981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.056692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.056793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.057051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.057178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.057308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.057530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.057683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.057756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.057953] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.058165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.058295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.058391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.058585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.058697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.058814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.058939] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.562228] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1218.586329] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.586592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.586592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.586771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.586995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.587355] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.587486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.587570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.587767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.587875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.588138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.588257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.588379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.588646] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.588744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.588963] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.589082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.589139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.589286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.589361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.589447] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1218.649889] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.650163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.650163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.650384] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.650600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.671350] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1220.298708] env[65738]: INFO networking_nsxv3.common.synchronization [req-2d1489b7-faf3-4cdb-96ab-53599d68d81e req-0da62c12-c397-459a-8d0b-0f83a6de8b2e tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1220.298708] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1220.299776] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.300136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.301304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.303539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.303539] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.303539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.303539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.303539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.303539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.303539] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.606707] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.607408] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-309" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.607408] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-309" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.608055] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-309" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.608194] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.608505] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.608684] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.609038] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.609271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.609602] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.609794] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.609979] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.610169] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.610384] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.610576] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.610784] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.632560] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.632759] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1220.632944] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.633188] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-309" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.633612] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-a53d905a-bca9-4a36-a407-8289da03cbdf taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.633837] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.633999] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.634504] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.634691] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a53d905a-bca9-4a36-a407-8289da03cbdf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.688538] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1220.688770] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.805175] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.805387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.805466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.805747] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.805872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.806119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.806346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.806420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.806622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.806707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.806805] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 already deleted. [ 1220.806888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.137758] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.138022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.138164] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.138521] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.138669] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.138846] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port a53d905a-bca9-4a36-a407-8289da03cbdf not found, creating... [ 1221.139131] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.139287] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.139404] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.139627] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.139767] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.140063] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.140219] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.140335] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.140566] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.140700] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.140891] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: a53d905a-bca9-4a36-a407-8289da03cbdf is going to be created. [ 1221.162636] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.162893] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.162996] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.163292] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.163530] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.163760] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.874033] env[65738]: INFO networking_nsxv3.common.synchronization [req-2d1489b7-faf3-4cdb-96ab-53599d68d81e req-9ccfe326-fd3d-4ac0-965c-89df02abcb32 service nova] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1221.874647] env[65738]: INFO networking_nsxv3.common.synchronization [req-2d1489b7-faf3-4cdb-96ab-53599d68d81e req-9ccfe326-fd3d-4ac0-965c-89df02abcb32 service nova] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1221.874879] env[65738]: INFO networking_nsxv3.common.synchronization [req-2d1489b7-faf3-4cdb-96ab-53599d68d81e req-9ccfe326-fd3d-4ac0-965c-89df02abcb32 service nova] Enqueued Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1221.875769] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1221.875963] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1221.876179] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1221.876518] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.876649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.876794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.877147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.877269] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.878842] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.879307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.879481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.879840] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.880101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.880396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.880530] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.880893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.881029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.881171] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.882708] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a53d905a-bca9-4a36-a407-8289da03cbdf taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.882881] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.883029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.883285] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.883919] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a53d905a-bca9-4a36-a407-8289da03cbdf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.380105] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.380279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.384110] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.386547] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a53d905a-bca9-4a36-a407-8289da03cbdf with status ACTIVE [ 1222.387093] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.387093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.387093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.387274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.387274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.387501] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.387568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.387686] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.387835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.387890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.388062] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.388169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.388230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.388573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.388573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.388573] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a53d905a-bca9-4a36-a407-8289da03cbdf is going to be updated. [ 1222.420416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.420416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.420416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.420416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.420416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.420416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.886653] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.389919] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.390156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.390156] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.390368] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.390514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.390602] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be created. [ 1223.418178] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.418178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.418178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.418178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.418178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.428575] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: UNINITIALIZED for 2s [ 1225.353769] env[65738]: INFO networking_nsxv3.common.synchronization [req-d85b32af-0165-479b-b546-e9c0a79c2a3f req-6705a1d7-c51a-47ea-b3b8-1d78097ee315 tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1225.354270] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGHEST for action security_group_members [ 1225.354617] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.354767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.354839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.355062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.355225] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.355324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.355394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.356073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.356073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.356073] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.440046] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1225.440296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.440461] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.440778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.440971] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.441101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.441176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.441400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.441400] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.441510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.441603] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.858055] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.858055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.858055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.858055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.858055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.858349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.858349] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.858423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.858581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.858642] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.858735] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1c642a-c375-4b06-8293-de7939b50479 is going to be updated. [ 1225.891059] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.891059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.891059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.891059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.892170] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.902851] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: IN_PROGRESS for 2s [ 1225.944795] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.944795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.944795] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.945344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.945344] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.945344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.945344] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.945624] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.945673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.945787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.946038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.946141] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.946218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.946356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.946528] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.946667] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.946725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.946912] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.946986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.947086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.947176] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.450463] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3d14ccb-ff93-4c6f-9478-a80910971ba7: rpc.has_security_group_logging(os_id): False [ 1226.468584] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.468772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.468772] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.468927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.469020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.469212] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.469314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.469394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.469591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.469800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.469879] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.469968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.470055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.470198] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.470269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.470506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.470602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.470663] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.470801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.470872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.470974] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be created. [ 1226.528101] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.528308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.528355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.529034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.529034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.543881] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1227.915100] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac1c642a-c375-4b06-8293-de7939b50479 in Status: SUCCESS [ 1227.915100] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac1c642a-c375-4b06-8293-de7939b50479 deletion is rescheduled due to dependency. [ 1227.915100] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.556386] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1228.556598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.943875] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.944176] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.944218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.944480] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.944770] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.944939] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.945068] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.945288] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.945430] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.945630] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.945746] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1229.945877] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1229.945989] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.946115] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.946240] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.946352] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.965163] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.965334] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1229.965468] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.965644] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-403" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.966026] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.966252] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.966384] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.966680] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.966843] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51fe28d-0aaf-4b51-b6e5-20bcdf779680',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.355034] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.355160] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.473022] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.473022] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.473022] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.473581] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.473581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.473581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.473581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.473581] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.473581] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 is going to be updated. [ 1230.495963] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.496261] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.496418] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.496731] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.496937] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.497187] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [req-7124fdc0-59e7-44e5-bca9-b8d0ac0bee6c req-970e97c5-ebc0-4e2c-bea8-cd87cf87976c service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [req-7124fdc0-59e7-44e5-bca9-b8d0ac0bee6c req-970e97c5-ebc0-4e2c-bea8-cd87cf87976c service nova] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [req-7124fdc0-59e7-44e5-bca9-b8d0ac0bee6c req-970e97c5-ebc0-4e2c-bea8-cd87cf87976c service nova] Enqueued Resource ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with Priority: HIGHEST for action port [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_rules [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1231.625158] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with Priority: HIGHEST for action port [ 1231.625158] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.625158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.625158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.625158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.625158] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.625795] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.625868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.625905] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.626164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.626231] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.626328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.626387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.626523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.626607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.626693] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.627792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.627792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.627878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.628012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.628102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b51fe28d-0aaf-4b51-b6e5-20bcdf779680',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.129783] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.130105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.130225] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.131093] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b51fe28d-0aaf-4b51-b6e5-20bcdf779680 with status ACTIVE [ 1232.131283] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.131554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.131554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.131852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.131852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.131942] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.132039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.132102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.132247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.132308] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.132493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.132584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.132637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.132776] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.132851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.132922] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b51fe28d-0aaf-4b51-b6e5-20bcdf779680 is going to be updated. [ 1232.156128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.156333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.156396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.156607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.156746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.156908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b51fe28d-0aaf-4b51-b6e5-20bcdf779680" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.635217] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.137269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.137535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.137535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.137750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.137852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.137936] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1233.169901] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.170164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.170164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.170327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.170463] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.179603] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1235.193234] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1235.193583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.193658] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.193925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.194084] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.194204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.194276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.194431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.194519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.194603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.194700] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.697165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.697393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.697442] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.697650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.697826] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.697929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.697993] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.698160] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.698246] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.698333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.698531] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.698616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.698678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.698819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.698973] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.699082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.699143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.699281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.699358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.699440] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.699533] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.202185] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6db86bd4-3bec-4519-a16c-37ef219df535: rpc.has_security_group_logging(os_id): False [ 1236.219948] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.220165] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.220211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.220439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.220588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.220813] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.220903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.220968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.221135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.221212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.221403] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.221498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.221588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.221722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.221793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.221987] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.222093] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.222152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.222286] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.222355] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.222438] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1236.292090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.292090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.292090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.292371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.292371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.309053] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1236.625201] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1236.625201] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1238.013510] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.014093] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.015068] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.015068] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.015068] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.015068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.015068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.015324] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.015432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.015481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.015576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.016260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.016260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.016260] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.016928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aaca18c-e768-43ac-9758-75336afad27e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.017318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.017318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.017318] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.017707] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.017707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.017707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.017896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.017896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.017998] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.062394] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_rules [ 1238.062579] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.062711] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1238.062844] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.063149] env[65738]: INFO networking_nsxv3.common.synchronization [req-3994dad5-ad6d-4cb8-bfb3-c9c19b06820c req-2b0a7df0-e482-43b8-b2f4-3c1b88c72901 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1238.063692] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_rules [ 1238.063861] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1238.063984] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1238.064098] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.064161] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.064429] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1aaca18c-e768-43ac-9758-75336afad27e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.064576] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.064644] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.064873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.064955] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.065905] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.066146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.066146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.066360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.066431] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.067997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a53d905a-bca9-4a36-a407-8289da03cbdf taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.067997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.067997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.067997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.067997] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a53d905a-bca9-4a36-a407-8289da03cbdf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.068755] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aaca18c-e768-43ac-9758-75336afad27e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.068900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.069067] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.069133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.331178] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1238.331560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.415248] env[65738]: INFO networking_nsxv3.common.synchronization [req-97ef364c-cd47-4115-80d9-8fd829ffccf5 req-7eceba9c-9732-4b81-91be-357b0f5b1f6a tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.415470] env[65738]: INFO networking_nsxv3.common.synchronization [req-97ef364c-cd47-4115-80d9-8fd829ffccf5 req-7eceba9c-9732-4b81-91be-357b0f5b1f6a tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.416037] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.416216] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaca18c-e768-43ac-9758-75336afad27e with Priority: HIGHEST for action security_group_members [ 1238.416618] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.416771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.417093] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aaca18c-e768-43ac-9758-75336afad27e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.417250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.462243] env[65738]: INFO networking_nsxv3.common.synchronization [req-97ef364c-cd47-4115-80d9-8fd829ffccf5 req-7eceba9c-9732-4b81-91be-357b0f5b1f6a tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1238.462430] env[65738]: INFO networking_nsxv3.common.synchronization [req-97ef364c-cd47-4115-80d9-8fd829ffccf5 req-7eceba9c-9732-4b81-91be-357b0f5b1f6a tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.462583] env[65738]: INFO networking_nsxv3.common.synchronization [req-97ef364c-cd47-4115-80d9-8fd829ffccf5 req-7eceba9c-9732-4b81-91be-357b0f5b1f6a tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1238.463175] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_rules [ 1238.463296] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1238.463392] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a53d905a-bca9-4a36-a407-8289da03cbdf with Priority: HIGHEST for action port [ 1238.463669] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.463788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.464018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.464018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.464301] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a53d905a-bca9-4a36-a407-8289da03cbdf taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.464301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.519802] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.520985] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.570422] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.570723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.570986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-1aaca18c-e768-43ac-9758-75336afad27e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.571146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.571304] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a53d905a-bca9-4a36-a407-8289da03cbdf with status ACTIVE [ 1238.571472] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.571694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.571796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.572034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.572132] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.572318] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.572421] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.572483] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.572648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.572718] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.572915] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.573057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.573128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.573294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.573371] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.573459] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a53d905a-bca9-4a36-a407-8289da03cbdf is going to be updated. [ 1238.598141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.598375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.598375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.598603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.598799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.598920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.599439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.599702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.599702] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a53d905a-bca9-4a36-a407-8289da03cbdf',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.023140] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.024338] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.102756] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a53d905a-bca9-4a36-a407-8289da03cbdf with status ACTIVE [ 1239.103081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.103243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.103319] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.103543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.103633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.103865] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.103975] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.104083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.104249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.104348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.104580] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.104697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.104765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.104934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.105211] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.105211] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a53d905a-bca9-4a36-a407-8289da03cbdf is going to be updated. [ 1239.130466] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.130707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.130786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.131125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.131327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.131567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a53d905a-bca9-4a36-a407-8289da03cbdf" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.529023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.529023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1239.529023] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.529023] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.529023] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aaca18c-e768-43ac-9758-75336afad27e is going to be created. [ 1239.555437] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.556501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.556616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.556804] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.556974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.559073] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.559073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.559073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.559361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.559361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.570134] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1239.570819] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aaca18c-e768-43ac-9758-75336afad27e in Status: UNINITIALIZED for 2s [ 1239.938808] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1239.938963] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1240.788010] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.788316] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.788355] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.788664] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.788937] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.789726] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.789971] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.790238] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.790388] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.790662] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.790815] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.790894] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.791018] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.791129] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.791236] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.791368] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.813745] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.813927] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1240.814147] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.814240] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-520" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.814549] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.814722] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.814843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.815125] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.815254] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71c001f-eb70-44ff-8b61-05f1f0ed10cb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.318818] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.319101] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.319255] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.319603] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.319764] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.320089] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.320250] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.320376] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.320685] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.320878] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.321201] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.321362] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.321479] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.321899] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.322084] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.322259] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb is going to be updated. [ 1241.350046] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.350314] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.350472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.350821] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.351034] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.351271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.580977] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1241.581188] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.581330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.581533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.581734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.581867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.581934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.582105] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.582187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.582274] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.583754] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1aaca18c-e768-43ac-9758-75336afad27e in Status: SUCCESS [ 1241.583925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.584083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.584253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.584423] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.584523] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.584588] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.584723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.584801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.584884] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.045464] env[65738]: INFO networking_nsxv3.common.synchronization [req-d573e538-b914-460f-8157-81be5465ae32 req-0f2f75a8-9650-4508-ab83-5f48ed7dc871 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1242.045711] env[65738]: INFO networking_nsxv3.common.synchronization [req-d573e538-b914-460f-8157-81be5465ae32 req-0f2f75a8-9650-4508-ab83-5f48ed7dc871 service nova] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1242.045814] env[65738]: INFO networking_nsxv3.common.synchronization [req-d573e538-b914-460f-8157-81be5465ae32 req-0f2f75a8-9650-4508-ab83-5f48ed7dc871 service nova] Enqueued Resource ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb with Priority: HIGHEST for action port [ 1242.046397] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_rules [ 1242.046528] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1242.046626] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb with Priority: HIGHEST for action port [ 1242.046897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.047136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.047235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.047444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.047549] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.048822] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.048950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.049036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.049313] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.049462] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.049557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.049614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.049755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.049839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.050010] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.051128] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.051327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.051707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.051870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.051945] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71c001f-eb70-44ff-8b61-05f1f0ed10cb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.085975] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.086886] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.087029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.087095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.087297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.087386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.087566] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.087702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.087764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.087920] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.088222] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.088300] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aaca18c-e768-43ac-9758-75336afad27e is going to be deleted. [ 1242.120346] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.120559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.120559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.120805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.120900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.121009] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.121184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.121360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.121536] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.121758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.121758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.121856] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.121938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.122046] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.549296] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.549364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.551876] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.554062] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b71c001f-eb70-44ff-8b61-05f1f0ed10cb with status ACTIVE [ 1242.554247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.554366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.554425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.554640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.554766] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.555033] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.555150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.555212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.555534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.555534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.555671] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.555743] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.555774] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.555895] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.556073] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.556073] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b71c001f-eb70-44ff-8b61-05f1f0ed10cb is going to be updated. [ 1242.576725] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.576974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.576974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.577140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.577272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.577427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b71c001f-eb70-44ff-8b61-05f1f0ed10cb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.590201] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.625026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.625026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.625026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.625026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.625026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.625026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.625374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.625374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.625374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.625374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.625567] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aaca18c-e768-43ac-9758-75336afad27e already deleted. [ 1242.625567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.625634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.625752] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.625896] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.625985] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.626085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.626189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.626257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.626347] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.054801] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.092758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.092965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.092965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.093209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.093297] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.093395] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1243.123472] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.123674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.123674] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.123860] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.124028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.127924] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.128075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.128117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.128277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.128356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.128530] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.128626] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.128673] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.128814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.128886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.128968] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1aaca18c-e768-43ac-9758-75336afad27e already deleted. [ 1243.129055] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.129145] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.133296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1243.556859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.557129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.557129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.557433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.557492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.557581] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1243.603582] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.603849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.603849] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.603988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.604620] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.615958] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1243.634132] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1aaca18c-e768-43ac-9758-75336afad27e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.654446] env[65738]: INFO networking_nsxv3.common.synchronization [req-e6a6f067-dd57-4e35-9a69-22eb5c5ca62f req-8379543b-bcb6-465a-be05-db4728be1750 tempest-ServerRescueTestJSONUnderV235-197123722 tempest-ServerRescueTestJSONUnderV235-197123722-project-member] Enqueued Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1243.655341] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 with Priority: HIGHEST for action security_group_members [ 1243.655695] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d14ccb-ff93-4c6f-9478-a80910971ba7 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.655828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.138662] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1aaca18c-e768-43ac-9758-75336afad27e: rpc.has_security_group_logging(os_id): False [ 1244.158068] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.158252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.158252] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.158449] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.158538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.158735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.158830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.158893] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.159053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.159125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.159210] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1aaca18c-e768-43ac-9758-75336afad27e is going to be created. [ 1244.175753] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e], does not exist path=[/infra/domains/default/groups/1aaca18c-e768-43ac-9758-75336afad27e]."\n}' [ 1244.175921] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1aaca18c-e768-43ac-9758-75336afad27e failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e [ 1244.176017] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1244.218931] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.219191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.219191] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.219345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.220685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.220959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.221076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.221140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.221299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.221375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.221541] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.221647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.221711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.221847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.221916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.221997] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1aaca18c-e768-43ac-9758-75336afad27e is going to be created. [ 1244.235961] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e], does not exist path=[/infra/domains/default/groups/1aaca18c-e768-43ac-9758-75336afad27e]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e [ 1244.236167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1aaca18c-e768-43ac-9758-75336afad27e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.236326] env[65738]: Traceback (most recent call last): [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1244.236389] env[65738]: return func(*args, **kwargs) [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1244.236389] env[65738]: res.raise_for_status() [ 1244.236389] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1244.236389] env[65738]: raise HTTPError(http_error_msg, response=self) [ 1244.236389] env[65738]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e [ 1244.236389] env[65738]: During handling of the above exception, another exception occurred: [ 1244.236389] env[65738]: Traceback (most recent call last): [ 1244.236389] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1244.236389] env[65738]: listener.cb(fileno) [ 1244.236389] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1244.236389] env[65738]: result = function(*args, **kwargs) [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1244.236389] env[65738]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1244.236389] env[65738]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1244.236389] env[65738]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1244.236389] env[65738]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1244.236389] env[65738]: res.raise_for_status() [ 1244.236389] env[65738]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1244.236389] env[65738]: raise HTTPError(http_error_msg, response=self) [ 1244.236389] env[65738]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1aaca18c-e768-43ac-9758-75336afad27e [ 1244.236389] env[65738]: Removing descriptor: 69 [ 1245.146039] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1245.146445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.146445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.146535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.146651] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.146764] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.146821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.147008] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.147130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.147232] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.625905] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1245.626282] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.626456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.626705] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.626928] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.627102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.627161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.627346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.627460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.627543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.627699] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.649467] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.649712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.649870] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.650171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.669600] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.669989] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.670158] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.670264] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.670519] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.670661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.670804] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1245.698141] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.698348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.698348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.698603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.698784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.707508] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1246.129943] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.631930] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b02ac3e-b94a-42ba-b911-23fb0744001d: rpc.has_security_group_logging(os_id): False [ 1246.651828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.652046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.652088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.652410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.672390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.672896] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.673074] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.673127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.673301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.673383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.673473] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1246.735830] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.736028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.736085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.736481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.736734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.752826] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1247.452396] env[65738]: INFO networking_nsxv3.common.synchronization [req-5b49f388-5279-4e5d-9f45-0d4e435986ed req-be5a530b-0a5b-447b-80f6-c01fa1864af5 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1247.453741] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1247.454699] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.454802] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.454901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.455166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.455417] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.456143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.456143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.456143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.456143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.456143] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.722173] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1247.722566] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 deletion is rescheduled due to dependency. [ 1247.722566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.722965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.723251] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.723445] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.723558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.723633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.723768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.723848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.723938] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.958907] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.227056] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.227278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.227278] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.227498] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.227587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.227789] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.227890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.227963] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.228133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.228208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.228299] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1248.263180] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.263180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.263180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.263180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.263180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.273949] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1248.461453] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.772740] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1248.772740] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.964768] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.964965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.964965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.965284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.965411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.965504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be updated. [ 1248.998026] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.998283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.998283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.998447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.998697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.008990] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1250.282955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1250.283235] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 deletion is rescheduled due to dependency. [ 1250.283235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.283358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.283566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.283755] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.283866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.283935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.284104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.284182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.284265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.284410] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.285208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.285373] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.285534] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.285633] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.285693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.285830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.285906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.285988] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.788534] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.790018] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.790445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.790445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.790445] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.790609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.791390] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.791390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.791390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.791390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.791390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.791390] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1250.818583] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.818864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.818864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.819172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.819390] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.829999] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1251.022704] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1251.023152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.293370] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3d14ccb-ff93-4c6f-9478-a80910971ba7: rpc.has_security_group_logging(os_id): False [ 1251.314194] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.314446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.314446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.314675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.314750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.314981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.315126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.315164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.315757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.315757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.315757] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be updated. [ 1251.384513] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.384754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.384754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.384939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.385202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.399642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: IN_PROGRESS for 2s [ 1252.454821] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.455146] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1252.841296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1252.841502] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 deletion is rescheduled due to dependency. [ 1252.841578] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.415558] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 in Status: SUCCESS [ 1253.415558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.415786] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.415927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.416032] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d14ccb-ff93-4c6f-9478-a80910971ba7',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.938819] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.939161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.939161] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.939277] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.955604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.955742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d14ccb-ff93-4c6f-9478-a80910971ba7 is going to be deleted. [ 1253.993585] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.993836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.993836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.993983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.994052] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.994142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d14ccb-ff93-4c6f-9478-a80910971ba7" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.874999] env[65738]: INFO networking_nsxv3.common.synchronization [req-1ee9c091-dfc3-4155-a83e-65766066adbb req-fa55223a-c4e9-4223-a1ac-22f3c9e5d321 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1254.875556] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGHEST for action security_group_members [ 1254.875860] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.875983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.876172] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.876382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.876540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.876640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.876703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.876848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.876932] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.877034] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.379878] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.380244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.380244] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.380689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.402540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.402540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.402540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.402540] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.402877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.402877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.402933] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be updated. [ 1255.428348] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.428596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.428596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.428812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.428868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.437549] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: IN_PROGRESS for 2s [ 1257.451099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 in Status: SUCCESS [ 1257.451364] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 deletion is rescheduled due to dependency. [ 1257.451411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.887572] env[65738]: INFO networking_nsxv3.common.synchronization [req-9f254180-2c12-4e83-9b6f-96a02c8ba503 req-26c6f0f1-3633-4ab1-bedf-b33210e0c85f tempest-ServerActionsTestOtherB-925995590 tempest-ServerActionsTestOtherB-925995590-project-member] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1258.888011] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGHEST for action security_group_members [ 1258.888367] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.888514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.888604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.888841] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.889030] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.889571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.889571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.889571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.889571] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.889729] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.392234] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.392448] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.392508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.392697] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.392828] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.393098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.393248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.393327] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.393537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.393632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.393728] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be updated. [ 1259.420735] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.420971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.421039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.421249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.421425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.430428] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: IN_PROGRESS for 2s [ 1260.515033] env[65738]: INFO networking_nsxv3.common.synchronization [None req-201c458f-692d-4c63-8243-e1fc65e7fed4 tempest-AttachInterfacesTestJSON-393436000 tempest-AttachInterfacesTestJSON-393436000-project-member] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1260.515033] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGHEST for action security_group_members [ 1260.515285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.515394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.515459] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.515654] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.515804] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.515900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.516098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.516255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.516416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.516460] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.020427] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.020427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.020427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.020427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.040098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.040385] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.040556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.040655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.041018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.041157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.041198] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be updated. [ 1261.070586] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.070757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.070846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.071104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.071249] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.081272] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: IN_PROGRESS for 2s [ 1261.442205] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d in Status: SUCCESS [ 1261.442205] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d deletion is rescheduled due to dependency. [ 1261.442205] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.548440] env[65738]: INFO networking_nsxv3.common.synchronization [req-25787e63-cff8-4a7d-9f4f-22f7eaf008a9 req-47a00f63-beae-4859-a10d-2289348eaff4 tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1262.549155] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1262.549521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.549672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.549808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.550067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.550404] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.550563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.550635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.550872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.550981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.551159] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.053649] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.053800] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.053873] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.054218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.079209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.079659] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.079659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.079659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.079866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.079973] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.080059] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1263.091451] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6db86bd4-3bec-4519-a16c-37ef219df535 in Status: SUCCESS [ 1263.091656] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 deletion is rescheduled due to dependency. [ 1263.091794] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.109924] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.110095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.110139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.110351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.110515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.120240] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1265.133323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1265.133612] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b deletion is rescheduled due to dependency. [ 1265.133612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.637054] env[65738]: INFO networking_nsxv3.common.synchronization [None req-47f49849-7e60-410b-8bd0-1995fe544cc3 None None] Enqueued Resource ID: c69a2eb7-c94c-44ba-9c9e-58f4c7b92218 with Priority: HIGHEST for action port [ 1265.637054] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69a2eb7-c94c-44ba-9c9e-58f4c7b92218 with Priority: HIGHEST for action port [ 1265.637054] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69a2eb7-c94c-44ba-9c9e-58f4c7b92218 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.637054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69a2eb7-c94c-44ba-9c9e-58f4c7b92218" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.637733] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69a2eb7-c94c-44ba-9c9e-58f4c7b92218" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.638235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69a2eb7-c94c-44ba-9c9e-58f4c7b92218" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.638433] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69a2eb7-c94c-44ba-9c9e-58f4c7b92218',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.140611] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c69a2eb7-c94c-44ba-9c9e-58f4c7b92218 [ 1266.140982] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.141067] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.141129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.141330] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.141416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.141509] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c69a2eb7-c94c-44ba-9c9e-58f4c7b92218 already deleted. [ 1266.141589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69a2eb7-c94c-44ba-9c9e-58f4c7b92218" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.020020] env[65738]: INFO networking_nsxv3.common.synchronization [None req-500a44dc-0a0f-45d0-a71f-14d3571d9341 None None] Enqueued Resource ID: 7a88687a-3514-43f1-a442-ed7f3a895b56 with Priority: HIGHEST for action port [ 1268.020020] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a88687a-3514-43f1-a442-ed7f3a895b56 with Priority: HIGHEST for action port [ 1268.020020] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a88687a-3514-43f1-a442-ed7f3a895b56 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.020020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a88687a-3514-43f1-a442-ed7f3a895b56" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.020020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a88687a-3514-43f1-a442-ed7f3a895b56" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.020020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a88687a-3514-43f1-a442-ed7f3a895b56" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.020020] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a88687a-3514-43f1-a442-ed7f3a895b56',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.522227] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a88687a-3514-43f1-a442-ed7f3a895b56 [ 1268.522758] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.522758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.522758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.523098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.523098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.523217] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a88687a-3514-43f1-a442-ed7f3a895b56 already deleted. [ 1268.523217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a88687a-3514-43f1-a442-ed7f3a895b56" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.883630] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.883836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.883836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.884135] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.884312] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.387479] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.876072] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b9385ba-708d-4938-b9ba-8a3e7adf8b38 req-439edaf2-dd38-4e4d-92c1-67e2455a414b tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1269.876612] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1269.876914] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.877178] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.877266] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.877470] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.877642] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.877768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.877816] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.877942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.878035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.878132] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.889446] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.147464] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.147687] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.147814] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.148110] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.148372] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.148531] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.148648] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.148890] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.149061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.149281] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.149389] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.149494] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.149597] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.149702] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.149808] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.149943] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.170294] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.170471] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.170610] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.170793] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.171216] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-217d39fc-3be0-46b7-bbbc-d2bd4e652856 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.171423] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.171549] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.171884] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.172075] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217d39fc-3be0-46b7-bbbc-d2bd4e652856',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.381060] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.381280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.381280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.381506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.381594] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.381785] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.381904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.381968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.382131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.382208] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.382293] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1270.391210] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1270.391210] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1270.414453] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.414610] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.414655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.414850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.414986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.429574] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1270.674501] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.674785] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.674871] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.675173] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.675319] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.675481] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port 217d39fc-3be0-46b7-bbbc-d2bd4e652856 not found, creating... [ 1270.675741] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.675898] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.676049] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.676698] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.676847] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.677164] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.677327] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.677443] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.677655] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.677784] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.677923] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: 217d39fc-3be0-46b7-bbbc-d2bd4e652856 is going to be created. [ 1270.698574] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.698804] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.698958] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.699246] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.699472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.699695] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.242054] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.242226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.242226] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.242427] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.257902] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1271.259357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.261489] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1271.313052] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.313248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.313296] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.313511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.326374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.327136] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1271.327219] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.327309] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1271.384035] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.384245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.384245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.384438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.385521] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.385696] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1271.400635] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b9385ba-708d-4938-b9ba-8a3e7adf8b38 req-ccc218b3-fc8d-4077-b567-b91e2d69d6e3 service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 1271.400981] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b9385ba-708d-4938-b9ba-8a3e7adf8b38 req-ccc218b3-fc8d-4077-b567-b91e2d69d6e3 service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1271.401243] env[65738]: INFO networking_nsxv3.common.synchronization [req-7b9385ba-708d-4938-b9ba-8a3e7adf8b38 req-ccc218b3-fc8d-4077-b567-b91e2d69d6e3 service nova] Enqueued Resource ID: 217d39fc-3be0-46b7-bbbc-d2bd4e652856 with Priority: HIGHEST for action port [ 1271.401503] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 1271.401635] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1271.401728] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217d39fc-3be0-46b7-bbbc-d2bd4e652856 with Priority: HIGHEST for action port [ 1271.402431] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.402556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.402648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.402812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.402892] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.403777] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.403869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.404090] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-217d39fc-3be0-46b7-bbbc-d2bd4e652856 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.404194] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.404255] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.404418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.404483] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217d39fc-3be0-46b7-bbbc-d2bd4e652856',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.469652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.469902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.469902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.470337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.470499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.470769] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1271.552064] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.552064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.552064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.552394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.552473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.552753] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1271.552846] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bbeb4a5d-7195-44c9-b3bc-982306062ac6', 'bc778f57-9a35-46ae-9597-a5e999c47fd9', '2041f9c1-bd84-43e4-91ac-f0b92547a55b', 'fb392433-b27c-4f33-a766-634f0f6c0dcb', '6db86bd4-3bec-4519-a16c-37ef219df535', 'e8eba3bd-4aa0-4ad6-921f-6d4d71a20221', '920ae10a-0841-419d-a6d6-5fc98d4eb318', '8fc0f4a9-1474-4292-821f-7f1aa18de95b', 'beb1b5dc-c27a-4190-9267-6cb5279fa23d', 'c7d9f780-2387-4768-9bde-778929c0c06d', '23565e98-53ea-4113-9741-85efc55da889', 'c8871243-0535-44e9-b0bd-b3fef12e1c90', 'bc457931-d7fc-49b3-aa99-8b32b5550b7c', '3b02ac3e-b94a-42ba-b911-23fb0744001d', 'dd260df1-27ce-4a10-8b11-543f9fd7f080', '1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2', '664447af-cc63-464d-83e7-bc563a3e53c3', 'df92bfb8-0963-460c-8470-de80a6dd7728', '0a8cba6c-0779-4246-9afd-ecae574e4c9d', '5fb1ec78-dd9a-4648-b8b0-a049555e5a46', '5d9a650f-180d-4827-8a8a-cdff5aa50644', '8b62a35a-29b0-4826-a035-6eed21356980', 'ad710818-9f6b-4718-bff8-4836e8a61c3b', '194d1d45-daf3-4873-a0c4-a279f2704021', '13e04b13-1f3c-4f36-a68f-be19736a3742', '2b8b178e-30ff-4875-afce-3f12db8c8904', '93ac889c-a70d-42e4-9f0a-90c362835c16', '47750d4b-22bd-42e5-bf36-3cc17e08c0a0', 'ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05', 'f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee', 'ac1c642a-c375-4b06-8293-de7939b50479', '11be5bab-0ed1-4fcd-8cd0-a3658db651bc', '2b5f20e7-94a1-4514-adde-54a6960390c3', 'da85289d-08d2-4040-ba9b-31d7eea34c68', '21f8f014-13fa-4be1-97eb-834dadab33fd', '1cea2a24-1c24-47dc-87cf-758c1ad81488', '0abfdb06-6f7f-40a7-be5b-fa4298901330', '7e040984-bcc9-43b0-a9c8-bbd4511a7fc1', 'a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c', '5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b', '198f2d52-4200-42b2-be51-13b90ddae50d', '33ab54d8-f174-4187-9e64-2cd39cd90273', '60fa81d8-8f48-4912-b0e6-1cff6e6ccdff', '89618efc-1c71-4f3b-9cfc-d651fcf1fe99'} {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.552948] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1271.573285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.573420] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.573496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.573694] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.573779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.573902] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1271.573994] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.574070] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1271.646057] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.646271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.646271] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.646471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.647618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.647863] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1271.647979] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.648026] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1271.648099] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1271.648153] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1271.648222] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGH for action security_group_rules [ 1271.648315] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGH for action security_group_rules [ 1271.648397] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGH for action security_group_rules [ 1271.648455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 1271.648517] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGH for action security_group_rules [ 1271.648570] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGH for action security_group_rules [ 1271.648634] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGH for action security_group_rules [ 1271.648699] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGH for action security_group_rules [ 1271.648756] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGH for action security_group_rules [ 1271.648810] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGH for action security_group_rules [ 1271.648860] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGH for action security_group_rules [ 1271.648916] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGH for action security_group_rules [ 1271.648971] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGH for action security_group_rules [ 1271.649044] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 1271.649102] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 1271.649177] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGH for action security_group_rules [ 1271.649226] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGH for action security_group_rules [ 1271.649269] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGH for action security_group_rules [ 1271.649337] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGH for action security_group_rules [ 1271.649385] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGH for action security_group_rules [ 1271.649481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.906262] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.906468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.908776] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 217d39fc-3be0-46b7-bbbc-d2bd4e652856 with status ACTIVE [ 1271.908980] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.909102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.909163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.909409] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.909506] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.909682] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.909771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.909827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.909981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.910066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.910251] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.910335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.910393] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.910524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.910601] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.910670] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 217d39fc-3be0-46b7-bbbc-d2bd4e652856 is going to be updated. [ 1271.961584] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.961888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.961888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.962130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.962268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.962435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-217d39fc-3be0-46b7-bbbc-d2bd4e652856" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.135477] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-97053ac6-4e73-4e5c-a726-73e1336d98ef tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1272.136093] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1272.136259] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 with Priority: HIGH for action security_group_rules [ 1272.136371] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b with Priority: HIGH for action security_group_rules [ 1272.136467] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df92bfb8-0963-460c-8470-de80a6dd7728 with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664447af-cc63-464d-83e7-bc563a3e53c3 with Priority: HIGH for action security_group_rules [ 1272.137026] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d with Priority: HIGH for action security_group_rules [ 1272.137281] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 with Priority: HIGH for action security_group_rules [ 1272.137334] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c with Priority: HIGH for action security_group_rules [ 1272.137450] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 with Priority: HIGH for action security_group_rules [ 1272.137565] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23565e98-53ea-4113-9741-85efc55da889 with Priority: HIGH for action security_group_rules [ 1272.137676] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d9f780-2387-4768-9bde-778929c0c06d with Priority: HIGH for action security_group_rules [ 1272.137790] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d with Priority: HIGH for action security_group_rules [ 1272.137903] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 with Priority: HIGH for action security_group_rules [ 1272.138019] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b with Priority: HIGH for action security_group_rules [ 1272.138133] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db86bd4-3bec-4519-a16c-37ef219df535 with Priority: HIGH for action security_group_rules [ 1272.138273] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 with Priority: HIGH for action security_group_rules [ 1272.138400] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb392433-b27c-4f33-a766-634f0f6c0dcb with Priority: HIGH for action security_group_rules [ 1272.138717] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.138930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.139042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.139378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.139578] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.139716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.139805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.140051] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.140265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.140454] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.142030] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.142180] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.142274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.142456] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.142734] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbeb4a5d-7195-44c9-b3bc-982306062ac6',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.143986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.143986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.143986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.143986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.143986] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2041f9c1-bd84-43e4-91ac-f0b92547a55b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.144851] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-920ae10a-0841-419d-a6d6-5fc98d4eb318 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.144851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.144851] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.145190] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.145190] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('920ae10a-0841-419d-a6d6-5fc98d4eb318',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.145880] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd260df1-27ce-4a10-8b11-543f9fd7f080 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.146030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.146133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.146901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.146901] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd260df1-27ce-4a10-8b11-543f9fd7f080',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.147977] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.147977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.147977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.147977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.147977] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fb1ec78-dd9a-4648-b8b0-a049555e5a46',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.148817] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.148817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.148817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.149045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.149045] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a8cba6c-0779-4246-9afd-ecae574e4c9d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.149713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df92bfb8-0963-460c-8470-de80a6dd7728 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.149853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.149917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.150081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.150184] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df92bfb8-0963-460c-8470-de80a6dd7728',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.150955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664447af-cc63-464d-83e7-bc563a3e53c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.151062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.151101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.151279] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.151354] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664447af-cc63-464d-83e7-bc563a3e53c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.152285] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b02ac3e-b94a-42ba-b911-23fb0744001d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.152435] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.152528] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.152700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.152773] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b02ac3e-b94a-42ba-b911-23fb0744001d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.153481] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.154662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.154662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.154662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.154662] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.154662] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.154662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.154662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.155029] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.155029] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc457931-d7fc-49b3-aa99-8b32b5550b7c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.156267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8871243-0535-44e9-b0bd-b3fef12e1c90 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.156267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.156267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.156267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.156267] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8871243-0535-44e9-b0bd-b3fef12e1c90',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.156800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23565e98-53ea-4113-9741-85efc55da889 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.156970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.157060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.157486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.157486] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23565e98-53ea-4113-9741-85efc55da889',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.158477] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d9f780-2387-4768-9bde-778929c0c06d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.158477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.158477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.158477] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.158665] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d9f780-2387-4768-9bde-778929c0c06d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.159441] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.159538] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.159598] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.159746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.160587] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beb1b5dc-c27a-4190-9267-6cb5279fa23d',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.160800] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.160917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.160998] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.161176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.161248] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8eba3bd-4aa0-4ad6-921f-6d4d71a20221',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.162083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.162083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.162083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.162305] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.162305] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fc0f4a9-1474-4292-821f-7f1aa18de95b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.163088] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6db86bd4-3bec-4519-a16c-37ef219df535 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.163207] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.163273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.163425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.163497] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6db86bd4-3bec-4519-a16c-37ef219df535',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.164216] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc778f57-9a35-46ae-9597-a5e999c47fd9 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.165446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.165446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.165446] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.165446] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc778f57-9a35-46ae-9597-a5e999c47fd9',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.165613] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb392433-b27c-4f33-a766-634f0f6c0dcb taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.166687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.166687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.166687] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.166687] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb392433-b27c-4f33-a766-634f0f6c0dcb',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.195079] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.195240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.195299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.195516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.199138] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.199411] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.200336] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.200441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.205950] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.205950] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.220441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.220590] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2041f9c1-bd84-43e4-91ac-f0b92547a55b is going to be deleted. [ 1272.221703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.222037] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.240638] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.240767] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fb1ec78-dd9a-4648-b8b0-a049555e5a46 is going to be deleted. [ 1272.241712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.241930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.262295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.262470] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 920ae10a-0841-419d-a6d6-5fc98d4eb318 is going to be deleted. [ 1272.263386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.263596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.285476] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.285657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.288514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.288628] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbeb4a5d-7195-44c9-b3bc-982306062ac6 is going to be deleted. [ 1272.289511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.289726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.289827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.289952] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2041f9c1-bd84-43e4-91ac-f0b92547a55b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.322746] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.322892] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.322964] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.323253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.323378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.323531] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fb1ec78-dd9a-4648-b8b0-a049555e5a46" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.337863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.338046] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.338186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.338343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.338433] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.338554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-920ae10a-0841-419d-a6d6-5fc98d4eb318" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.382538] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.382676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.382722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.382969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.383072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.384025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbeb4a5d-7195-44c9-b3bc-982306062ac6" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.445405] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1272.445756] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b deletion is rescheduled due to dependency. [ 1272.445756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.445883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.446231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.446526] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.446715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.446824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.447098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.447236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.447395] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.496136] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.496512] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.496770] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.497190] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.497506] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.497719] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.497853] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.498093] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.498238] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.498443] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.498553] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.498657] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.498761] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.498952] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.499082] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.499218] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.521901] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.522137] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1272.522285] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.522470] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.522792] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-ebe7f806-6186-48d7-b827-d3871d6d8478 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.522969] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.523107] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.523655] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.523655] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe7f806-6186-48d7-b827-d3871d6d8478',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.670494] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.670664] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.670707] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.670956] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.671060] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.671252] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.671352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.671415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.671783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.671783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.671783] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 already deleted. [ 1272.671783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.714985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.715235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.715235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.715431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.717113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.717220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.720897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.721062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.722981] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.723084] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.726217] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.726374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.727165] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.727258] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.727944] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.728057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.728814] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.728903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.729660] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.729750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.730479] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.730564] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.731263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.731354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.731941] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.732353] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.732653] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.733019] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.733432] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.733559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.734128] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.734516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.734607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.735186] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.735543] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.735635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.736221] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.736653] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.736756] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.737325] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.737715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.737824] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d9f780-2387-4768-9bde-778929c0c06d is going to be deleted. [ 1272.738688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.738917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.755994] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.756158] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc457931-d7fc-49b3-aa99-8b32b5550b7c is going to be deleted. [ 1272.757072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.757265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.855204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.855347] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beb1b5dc-c27a-4190-9267-6cb5279fa23d is going to be deleted. [ 1272.856280] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.856499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.876483] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.876645] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.877847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.877954] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8eba3bd-4aa0-4ad6-921f-6d4d71a20221 is going to be deleted. [ 1272.878930] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.879066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.889459] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.889623] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.896451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.896583] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2 is going to be deleted. [ 1272.897438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.897650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.910870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.911111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.916900] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.917098] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fc0f4a9-1474-4292-821f-7f1aa18de95b is going to be deleted. [ 1272.917937] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.918157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.949275] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.952083] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.952229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.956186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.956308] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b02ac3e-b94a-42ba-b911-23fb0744001d is going to be deleted. [ 1272.957204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.957419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.986193] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.986401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.993290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.993419] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8871243-0535-44e9-b0bd-b3fef12e1c90 is going to be deleted. [ 1272.994590] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.994796] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.016773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.016969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.026099] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.026334] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.026461] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.026747] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.026898] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.027072] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port ebe7f806-6186-48d7-b827-d3871d6d8478 not found, creating... [ 1273.027341] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.027500] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.027619] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.027834] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.027969] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.028298] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.028455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.028573] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.028805] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.028933] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.029089] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: ebe7f806-6186-48d7-b827-d3871d6d8478 is going to be created. [ 1273.039267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.039457] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd260df1-27ce-4a10-8b11-543f9fd7f080 is going to be deleted. [ 1273.040793] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.041128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.092786] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.093041] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.093150] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.093434] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.093674] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.093927] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.095652] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.095763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.096551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.096682] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6db86bd4-3bec-4519-a16c-37ef219df535 is going to be deleted. [ 1273.097501] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.097775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.113113] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.113338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.151568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.151748] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a8cba6c-0779-4246-9afd-ecae574e4c9d is going to be deleted. [ 1273.152944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.153301] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.233927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.234142] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb392433-b27c-4f33-a766-634f0f6c0dcb is going to be deleted. [ 1273.235155] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.235383] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.249604] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.249842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.291253] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.291513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.344813] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.344944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.345978] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.346117] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23565e98-53ea-4113-9741-85efc55da889 is going to be deleted. [ 1273.347783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.347883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.404157] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.404398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.416589] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.417291] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664447af-cc63-464d-83e7-bc563a3e53c3 is going to be deleted. [ 1273.418744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.419157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.451916] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.485036] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.485213] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc778f57-9a35-46ae-9597-a5e999c47fd9 is going to be deleted. [ 1273.486287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.486556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.525616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.525803] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df92bfb8-0963-460c-8470-de80a6dd7728 is going to be deleted. [ 1273.526831] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.527546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.527829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.527927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d9f780-2387-4768-9bde-778929c0c06d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.528985] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.529166] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.529204] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.529665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.529665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.529665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23565e98-53ea-4113-9741-85efc55da889" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.529806] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.529887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.530019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.530077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc457931-d7fc-49b3-aa99-8b32b5550b7c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.531289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.531452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.531542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.531708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beb1b5dc-c27a-4190-9267-6cb5279fa23d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.531897] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.532099] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.532189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.532350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8eba3bd-4aa0-4ad6-921f-6d4d71a20221" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.532511] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.532668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.532746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.532877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1032d3a5-9131-4a9b-a7b0-b3ac298e0ca2" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.533043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.533229] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.533352] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.533534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fc0f4a9-1474-4292-821f-7f1aa18de95b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.533665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.533815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.533903] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.534030] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b02ac3e-b94a-42ba-b911-23fb0744001d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.534167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.534309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.534381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.534493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8871243-0535-44e9-b0bd-b3fef12e1c90" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.534602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.534737] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.534810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.534921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd260df1-27ce-4a10-8b11-543f9fd7f080" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.535061] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.535200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.535272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.535378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6db86bd4-3bec-4519-a16c-37ef219df535" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.535485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.535618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.535689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.535790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a8cba6c-0779-4246-9afd-ecae574e4c9d" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.535917] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.536088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.536164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.536290] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb392433-b27c-4f33-a766-634f0f6c0dcb" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.561986] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.562219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.562219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.562312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.562662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.562662] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664447af-cc63-464d-83e7-bc563a3e53c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.600465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.600649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.600688] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.600951] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.601077] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.601186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc778f57-9a35-46ae-9597-a5e999c47fd9" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.664197] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.664488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.664488] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.664643] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.664728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.664848] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df92bfb8-0963-460c-8470-de80a6dd7728" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.760933] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-0dd2792c-ef2c-42c5-bced-29d1399a9664 service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1273.761164] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-0dd2792c-ef2c-42c5-bced-29d1399a9664 service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1273.761305] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-0dd2792c-ef2c-42c5-bced-29d1399a9664 service nova] Enqueued Resource ID: ebe7f806-6186-48d7-b827-d3871d6d8478 with Priority: HIGHEST for action port [ 1273.761889] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1273.761995] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1273.762140] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe7f806-6186-48d7-b827-d3871d6d8478 with Priority: HIGHEST for action port [ 1273.762398] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.762542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.762597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.762869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.762921] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.763761] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.763879] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.763948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.764131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.764278] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.764367] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.764418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.764556] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.764635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.764730] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.765757] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebe7f806-6186-48d7-b827-d3871d6d8478 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.765757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.765757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.765923] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.765923] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe7f806-6186-48d7-b827-d3871d6d8478',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.954990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.955268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.955325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.955567] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.955685] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.955785] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1273.990061] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.990263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.990263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.990543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.990723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.000683] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1274.267742] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.268765] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.268929] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.269028] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebe7f806-6186-48d7-b827-d3871d6d8478 with status ACTIVE [ 1274.269185] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.269292] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.269345] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.269558] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.269665] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.270412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.270412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.270412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.270412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.270412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.270412] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.270760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.270760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.270760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.270760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.270912] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebe7f806-6186-48d7-b827-d3871d6d8478 is going to be updated. [ 1274.313829] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-8e8ee0c1-6522-42ca-8394-fe29e31d5ef2 tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1274.314440] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1274.314970] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.315118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.321780] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.321933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.322045] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.322273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.322417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.322581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebe7f806-6186-48d7-b827-d3871d6d8478" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.631698] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.632019] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.632121] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.632384] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.632682] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.632851] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.632968] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.633222] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.633379] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.633582] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.633689] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.633793] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.633896] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.634016] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.634124] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.634254] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.653852] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.654079] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.654149] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.654322] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.654651] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-dd53201e-2f6c-4e72-9f08-36936a292643 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.654822] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.654940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.655299] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.655443] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd53201e-2f6c-4e72-9f08-36936a292643',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.772853] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.157895] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.158172] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.158275] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.158565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.158714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.158973] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port dd53201e-2f6c-4e72-9f08-36936a292643 not found, creating... [ 1275.159271] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.159432] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.159550] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.159775] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.159911] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.160211] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.160363] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.160475] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.160673] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.160803] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.161095] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: dd53201e-2f6c-4e72-9f08-36936a292643 is going to be created. [ 1275.181615] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.181816] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.182649] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.182967] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.183693] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.183693] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.275502] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.275710] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.275788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.275980] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.276139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.276251] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be created. [ 1275.324123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.324365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.324365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.324602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.324765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.337842] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: UNINITIALIZED for 2s [ 1275.903152] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-02229bdc-b7ed-41c9-8ad1-315574d5f113 service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1275.903438] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-02229bdc-b7ed-41c9-8ad1-315574d5f113 service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1275.903550] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-02229bdc-b7ed-41c9-8ad1-315574d5f113 service nova] Enqueued Resource ID: dd53201e-2f6c-4e72-9f08-36936a292643 with Priority: HIGHEST for action port [ 1275.904106] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1275.904261] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1275.904370] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd53201e-2f6c-4e72-9f08-36936a292643 with Priority: HIGHEST for action port [ 1275.904646] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.904741] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.904958] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.905072] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.905247] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd53201e-2f6c-4e72-9f08-36936a292643 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.905348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.905412] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.905700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.905831] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd53201e-2f6c-4e72-9f08-36936a292643',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.011150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1276.011375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.011559] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.011779] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.012037] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.012193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.012262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.012394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.012475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.012561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.012652] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.408207] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd53201e-2f6c-4e72-9f08-36936a292643 with status ACTIVE [ 1276.408486] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.408651] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.408729] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.409019] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.409152] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.409360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.409648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.409744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.409957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.409990] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.410195] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.410295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.410357] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.410493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.410565] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.410674] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd53201e-2f6c-4e72-9f08-36936a292643 is going to be updated. [ 1276.435578] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.436017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.436017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.436017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.436358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.436555] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd53201e-2f6c-4e72-9f08-36936a292643" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.515250] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.526816] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-43cf9626-4dc6-41ca-aa02-585cd3618e9b tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1276.527606] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1276.527968] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.528639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.018336] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b: rpc.has_security_group_logging(os_id): False [ 1277.036900] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.037167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.037219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.037563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.058315] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.058640] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.058777] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.058847] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.059056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.059157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.059259] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1277.120937] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.125075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.125075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.125075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.125075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.151458] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1277.257277] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.257588] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.257713] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.257985] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.258285] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.258441] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.258553] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.258783] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.258924] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.259440] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.259560] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1277.259716] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1277.259772] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1277.259885] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.259992] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1277.260152] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1277.289541] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1277.289714] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1277.289851] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1277.290037] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-948" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.290363] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-a30bf65b-9253-4a56-b984-ecf5b89b8353 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.290560] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.290675] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.291059] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.291205] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30bf65b-9253-4a56-b984-ecf5b89b8353',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.349055] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1277.349536] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.349883] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.349971] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.350120] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.350240] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.350361] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.350453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.350533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.350617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.350724] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.351724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.351916] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.352127] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.352979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.352979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.352979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.352979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.352979] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.794591] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.794591] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.794591] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.794965] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.795158] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.795343] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port a30bf65b-9253-4a56-b984-ecf5b89b8353 not found, creating... [ 1277.795641] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.795826] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.795952] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.796216] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.796357] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.796667] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.796843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.796994] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.797225] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.797377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.797524] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: a30bf65b-9253-4a56-b984-ecf5b89b8353 is going to be created. [ 1277.827951] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.827951] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.828343] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.828565] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.828923] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.829197] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.854250] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.854513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.855921] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.358811] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.535088] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-27973a11-418b-4da4-aba2-2cfee3ce370d service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1278.535298] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-27973a11-418b-4da4-aba2-2cfee3ce370d service nova] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1278.535414] env[65738]: INFO networking_nsxv3.common.synchronization [req-be4a5885-ab5a-4332-a740-3c402948cea2 req-27973a11-418b-4da4-aba2-2cfee3ce370d service nova] Enqueued Resource ID: a30bf65b-9253-4a56-b984-ecf5b89b8353 with Priority: HIGHEST for action port [ 1278.535911] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_rules [ 1278.536057] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1278.536155] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30bf65b-9253-4a56-b984-ecf5b89b8353 with Priority: HIGHEST for action port [ 1278.536416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.536513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.536701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.536781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.536952] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-a30bf65b-9253-4a56-b984-ecf5b89b8353 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.537081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.537115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.537304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.537494] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30bf65b-9253-4a56-b984-ecf5b89b8353',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.861674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.861924] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.862020] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.862369] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.862539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.862680] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1278.895057] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.895261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.895261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.895487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.895629] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.905831] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1279.039541] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a30bf65b-9253-4a56-b984-ecf5b89b8353 with status ACTIVE [ 1279.039821] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.039894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.040015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.040260] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.040358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.040592] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.040720] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.040784] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.041062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.041136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.041347] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.041447] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.041509] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.041669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.041746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.041832] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a30bf65b-9253-4a56-b984-ecf5b89b8353 is going to be updated. [ 1279.069718] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.069940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.069988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.070212] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.070351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.070510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a30bf65b-9253-4a56-b984-ecf5b89b8353" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.173021] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1279.173338] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.917478] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1280.917850] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.917888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.918108] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.918301] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.918417] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.918473] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.918628] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.918715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.918785] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.421243] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.924735] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.062356] env[65738]: INFO networking_nsxv3.common.synchronization [None req-b9529c17-10a5-499e-b4e0-e0b5faa4178b None None] Enqueued Resource ID: 235032bd-9527-4119-bc22-8c128baf4b11 with Priority: HIGHEST for action port [ 1282.063154] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 235032bd-9527-4119-bc22-8c128baf4b11 with Priority: HIGHEST for action port [ 1282.063452] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-235032bd-9527-4119-bc22-8c128baf4b11 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.063574] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-235032bd-9527-4119-bc22-8c128baf4b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.063641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-235032bd-9527-4119-bc22-8c128baf4b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.063904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-235032bd-9527-4119-bc22-8c128baf4b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.063987] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235032bd-9527-4119-bc22-8c128baf4b11',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.405355] env[65738]: INFO networking_nsxv3.common.synchronization [None req-3c912ff7-06cc-45d3-ab2a-11fa33952541 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1282.406313] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1282.406313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.406402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.406402] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.406661] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.406732] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.429231] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.429231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.429231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.429231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.429231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.429231] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1282.465898] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.466096] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.466192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.466415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.466561] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.475632] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1282.488246] env[65738]: INFO networking_nsxv3.common.synchronization [None req-fbb36ee2-69fd-4a43-9481-9d524422db4b tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1282.489165] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1282.489637] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.489750] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.566969] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 235032bd-9527-4119-bc22-8c128baf4b11 [ 1282.567156] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.567234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.567272] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.568227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.568227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.568227] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:235032bd-9527-4119-bc22-8c128baf4b11 already deleted. [ 1282.568227] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-235032bd-9527-4119-bc22-8c128baf4b11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.932838] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.933242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.933242] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.933403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.933546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.933652] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e already deleted. [ 1282.933744] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.933907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.934082] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.934191] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.459183] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.459406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.459406] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.459625] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.459700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.459804] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e already deleted. [ 1283.459909] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.006685] env[65738]: INFO networking_nsxv3.common.synchronization [None req-94f8fc2b-f80e-44f9-9422-6d326665e1e2 None None] Enqueued Resource ID: 96fbb243-a588-4e42-9e65-bee9179c4a4f with Priority: HIGHEST for action port [ 1284.007351] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96fbb243-a588-4e42-9e65-bee9179c4a4f with Priority: HIGHEST for action port [ 1284.007774] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-96fbb243-a588-4e42-9e65-bee9179c4a4f taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.007915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96fbb243-a588-4e42-9e65-bee9179c4a4f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.007982] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96fbb243-a588-4e42-9e65-bee9179c4a4f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.008337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96fbb243-a588-4e42-9e65-bee9179c4a4f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.008421] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fbb243-a588-4e42-9e65-bee9179c4a4f',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.486763] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1284.486989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.487231] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.487453] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.487639] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.487753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.487819] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.487962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.488054] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.488202] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.510140] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96fbb243-a588-4e42-9e65-bee9179c4a4f [ 1284.510418] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.510586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.510677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.510911] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.511094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.511225] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96fbb243-a588-4e42-9e65-bee9179c4a4f already deleted. [ 1284.511302] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96fbb243-a588-4e42-9e65-bee9179c4a4f" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.990829] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.493630] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.995793] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.995957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.995957] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.996768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.996768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.996768] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1286.041810] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.041987] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.042070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.042261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.042404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.052021] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1287.906383] env[65738]: INFO networking_nsxv3.common.synchronization [req-1ecc4a75-8a7a-4bf3-a0f1-3ecc9cb74a61 req-693b4b32-f039-47b4-b73a-ff08f4ad032e tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1287.906945] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1287.907265] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.907386] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.907450] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.907699] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.907861] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.907960] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.908033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.908185] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.908268] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.908523] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.064446] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1288.064734] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.064947] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.065452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.065541] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.065712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.065712] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.065877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.065997] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.066106] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.066309] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.066439] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.066513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.066711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.066873] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.066995] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.067111] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.067295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.067387] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.067481] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.067606] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.068675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.068760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.068960] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.069085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.069147] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.069289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.069364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.069464] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.200136] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.200340] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.200464] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.200828] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.201133] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.201310] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.201430] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.201651] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.201792] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.202018] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.202155] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.202268] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.202374] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.202483] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.202588] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.202723] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1288.223665] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1288.223894] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1288.224081] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1288.224271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.224584] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-d3b54a21-3141-4311-a9dd-51c84837670a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.224757] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.224878] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.225216] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.225356] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b54a21-3141-4311-a9dd-51c84837670a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.410560] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.410769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.410769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.410946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.411101] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.411316] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.411415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.411471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.411632] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.411708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.411795] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e already deleted. [ 1288.411907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.571219] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9de6ce3-f563-4877-8f1e-567344fe4380: rpc.has_security_group_logging(os_id): False [ 1288.572425] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.590140] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.590284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.590358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.590587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.590677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.590908] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.591095] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.591169] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.591320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.591622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.591622] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.591751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.591751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.591876] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.591925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.592112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.592293] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.592372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.592513] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.592587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.592672] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be created. [ 1288.652675] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.652675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.652675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.652675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.652675] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.666284] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1288.728031] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.728271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.728400] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.728998] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.729221] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.729386] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port d3b54a21-3141-4311-a9dd-51c84837670a not found, creating... [ 1288.729730] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.729830] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.729946] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.730210] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.730399] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.730760] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.730927] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.731111] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.731335] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.731472] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.731615] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: d3b54a21-3141-4311-a9dd-51c84837670a is going to be created. [ 1288.751043] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.751281] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.751406] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.751680] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.751904] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.752143] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.074303] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.455412] env[65738]: INFO networking_nsxv3.common.synchronization [req-1ecc4a75-8a7a-4bf3-a0f1-3ecc9cb74a61 req-771236f4-064b-4639-81d5-918d69199534 service nova] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1289.455599] env[65738]: INFO networking_nsxv3.common.synchronization [req-1ecc4a75-8a7a-4bf3-a0f1-3ecc9cb74a61 req-771236f4-064b-4639-81d5-918d69199534 service nova] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1289.455744] env[65738]: INFO networking_nsxv3.common.synchronization [req-1ecc4a75-8a7a-4bf3-a0f1-3ecc9cb74a61 req-771236f4-064b-4639-81d5-918d69199534 service nova] Enqueued Resource ID: d3b54a21-3141-4311-a9dd-51c84837670a with Priority: HIGHEST for action port [ 1289.456378] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1289.456437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1289.456542] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3b54a21-3141-4311-a9dd-51c84837670a with Priority: HIGHEST for action port [ 1289.456802] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.456922] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.456986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.457199] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.457275] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.458081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.458193] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.458261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.458423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.458565] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.458670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.458763] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.458866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.458925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.459602] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.459764] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3b54a21-3141-4311-a9dd-51c84837670a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.459864] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.459910] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.460075] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.460127] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b54a21-3141-4311-a9dd-51c84837670a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.578719] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.578961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.578961] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.579210] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.579304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.579403] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1289.608361] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.608586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.608586] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.608773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.608938] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.620626] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1289.961790] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.962956] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.963117] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.965013] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3b54a21-3141-4311-a9dd-51c84837670a with status ACTIVE [ 1289.965223] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.965310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.965374] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.965575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.965670] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.965878] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.966038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.966143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.966382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.966475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.966674] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.966757] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.966820] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.966970] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.967076] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.967160] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3b54a21-3141-4311-a9dd-51c84837670a is going to be updated. [ 1289.988064] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.988326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.988326] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.988551] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.988788] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.989126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.465869] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.625718] env[65738]: INFO networking_nsxv3.common.synchronization [req-6f10e8ad-c851-4aa5-b651-8590d1b2a24d req-1ddafdb4-933c-4753-9a69-59b7444de07d tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1290.627471] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1290.627471] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.627471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.679830] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1290.679830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.679830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.680083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.680083] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.967389] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.967597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.967655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.967834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.967925] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.968044] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e is going to be created. [ 1290.997134] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.997360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.997360] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.997599] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.997760] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.007296] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: UNINITIALIZED for 2s [ 1291.182407] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.182591] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.631504] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1291.632015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.632015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.632250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.632465] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.632583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.632728] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.632889] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.632992] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.633102] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.134966] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.637425] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.019203] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: SUCCESS [ 1293.019520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.019871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.020234] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.020510] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.020649] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.020761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.020962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.021153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.021300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.021428] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.139536] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.139771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.139771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.139986] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.140090] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.140190] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1293.172278] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.172495] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.172635] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.172908] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.173179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.183251] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1293.523692] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.027097] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6746dc41-8838-4c36-9c99-1ff4aced686e: rpc.has_security_group_logging(os_id): False [ 1294.046273] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.046499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.046499] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.046677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.046767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.047017] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.047125] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.047192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.047350] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.047425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.047511] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e is going to be created. [ 1294.109273] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.109516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.109516] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.109692] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.109877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.121730] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: IN_PROGRESS for 2s [ 1295.193765] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1295.194110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.194174] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.194391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.194580] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.194693] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.194753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.194965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.195065] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.195153] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.195245] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.628788] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.628952] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1295.697734] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.697942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.697942] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.698129] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.698325] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.698432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.698496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.698657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.698742] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.698829] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.698972] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.699091] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.699163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.699303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.699440] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.699524] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.699585] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.699715] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.699785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.699863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.699953] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.135441] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: SUCCESS [ 1296.135669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.202315] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9de6ce3-f563-4877-8f1e-567344fe4380: rpc.has_security_group_logging(os_id): False [ 1296.224875] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.225140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.225140] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.225358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.225452] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.225678] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.225798] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.225863] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.226059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.226145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.226416] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.226541] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.226616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.226785] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.226888] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.227129] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.227269] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.227332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.227494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.227584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.227682] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1296.303932] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.304103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.304183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.304500] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.304726] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.323546] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1297.406314] env[65738]: INFO networking_nsxv3.common.synchronization [req-12f62a2c-8ef2-46c6-9bcb-d6f1dd487f19 req-7552688b-8687-4e78-ba23-c1969a4eebd7 tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1297.407015] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1297.407386] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.407557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.407676] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.407996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.408228] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.408389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.408504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.408732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.408852] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.408992] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.504764] env[65738]: INFO networking_nsxv3.common.synchronization [req-89e7e666-cabc-4c08-8c38-c5ebffd901ed req-13454608-8f60-4e4a-8ca4-ad0ffd6463bb tempest-ListServersNegativeTestJSON-1313378834 tempest-ListServersNegativeTestJSON-1313378834-project-member] Enqueued Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1297.505430] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9de6ce3-f563-4877-8f1e-567344fe4380 with Priority: HIGHEST for action security_group_members [ 1297.505792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9de6ce3-f563-4877-8f1e-567344fe4380 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.505939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.914898] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.342438] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1298.342668] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.342845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.343085] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.343177] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.416838] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.866224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.866460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.866460] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.866648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.866749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.866857] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be deleted. [ 1298.919866] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.920130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.920284] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.920573] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.920669] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.920772] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be updated. [ 1298.934564] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.934792] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.934842] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.935107] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.935257] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.935437] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.986506] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.986751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.986751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.986877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.987022] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.007801] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: IN_PROGRESS for 2s [ 1301.018898] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9de6ce3-f563-4877-8f1e-567344fe4380 in Status: SUCCESS [ 1301.019322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.019377] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.019622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.019839] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.019979] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.020057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.020262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.020351] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.020467] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9de6ce3-f563-4877-8f1e-567344fe4380',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.522891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.523071] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.523127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.523342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.523431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.523649] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.523746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.523808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.523955] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.524042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.524130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9de6ce3-f563-4877-8f1e-567344fe4380 is going to be deleted. [ 1301.554343] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.554563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.554563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.555069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.555069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.555069] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9de6ce3-f563-4877-8f1e-567344fe4380" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.506628] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.507034] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.507628] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.507628] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.508417] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.508829] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.509311] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.509311] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.510432] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.510803] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.511410] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.511843] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.512871] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.513277] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.514039] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.514437] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.515283] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.515690] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.516376] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.516765] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.517395] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.518049] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.721709] env[65738]: INFO networking_nsxv3.common.synchronization [req-adc7bcce-cc17-482f-817a-a5bc26c44b52 req-477a8c1c-f514-4260-b465-727f3e4d88cb tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1352.722095] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1352.722421] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.722542] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.722602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.722815] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.723751] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.723751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.723751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.723751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.723751] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.723751] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.226661] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.226878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.226878] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.227130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.227270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.227490] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.227592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.227656] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.227812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.227890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.227975] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1353.268710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.268941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.268941] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.269144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.269325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.281495] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1355.292082] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1355.292485] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b deletion is rescheduled due to dependency. [ 1355.292485] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.723286] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.723658] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.709474] env[65738]: INFO networking_nsxv3.common.synchronization [req-8dbfdfdb-4b35-4bc8-b98c-74fa04b8371b req-26bb1365-3de1-4a90-a70b-5c2b7d442374 tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1360.710107] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1360.710370] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.710491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.710560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.710758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.710904] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.711009] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.711088] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.711247] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.711333] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.711425] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.016281] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.016507] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.016634] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.016904] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.017205] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.017572] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.017572] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.017714] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.017859] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.018086] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.018203] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1361.018313] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1361.018422] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1361.018531] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.018635] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1361.018766] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1361.039174] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1361.039358] env[65738]: DEBUG dogpile.cache.region [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1361.039494] env[65738]: DEBUG dogpile.lock [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1361.039804] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "network-446" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.040182] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.040453] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.040654] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.041040] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.041244] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80d96cc-68d5-48d7-bc59-01efc2ac9f11',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.213885] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.214131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.214131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.214304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.214404] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.214611] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.214716] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.214780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.214939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.215028] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.215118] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1361.242805] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.243057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.243057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.243256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.243396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.253563] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1361.544184] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.544507] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.544659] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.544940] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.545099] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.545308] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Segment Port b80d96cc-68d5-48d7-bc59-01efc2ac9f11 not found, creating... [ 1361.545583] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.545822] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.546093] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.546337] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.546478] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.546767] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.546925] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.547059] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.547302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.547421] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.547557] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Resource: SegmentPort with ID: b80d96cc-68d5-48d7-bc59-01efc2ac9f11 is going to be created. [ 1361.569348] env[65738]: DEBUG networking_nsxv3.common.locking [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.569544] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.569668] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.569981] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.570214] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.570435] env[65738]: DEBUG oslo_concurrency.lockutils [None req-eda048b1-df5f-4a23-9619-3081c91c3e5d None None] Releasing lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.252735] env[65738]: INFO networking_nsxv3.common.synchronization [req-8dbfdfdb-4b35-4bc8-b98c-74fa04b8371b req-e803b0cf-f87b-40f3-a3a6-7a0373fdb6fa service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 1362.253109] env[65738]: INFO networking_nsxv3.common.synchronization [req-8dbfdfdb-4b35-4bc8-b98c-74fa04b8371b req-e803b0cf-f87b-40f3-a3a6-7a0373fdb6fa service nova] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1362.253155] env[65738]: INFO networking_nsxv3.common.synchronization [req-8dbfdfdb-4b35-4bc8-b98c-74fa04b8371b req-e803b0cf-f87b-40f3-a3a6-7a0373fdb6fa service nova] Enqueued Resource ID: b80d96cc-68d5-48d7-bc59-01efc2ac9f11 with Priority: HIGHEST for action port [ 1362.253632] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_rules [ 1362.253800] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1362.253853] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b80d96cc-68d5-48d7-bc59-01efc2ac9f11 with Priority: HIGHEST for action port [ 1362.254135] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.254294] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.254332] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.254543] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.254581] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.256922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.257083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.257235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.257337] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.257401] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.257568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.257643] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80d96cc-68d5-48d7-bc59-01efc2ac9f11',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.759812] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.759812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.762208] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b80d96cc-68d5-48d7-bc59-01efc2ac9f11 with status ACTIVE [ 1362.762409] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.762549] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.762609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.762814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.762904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.763112] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.763201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.763267] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.763413] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.763487] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.763667] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.763749] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.763810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.763943] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.764025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.764109] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b80d96cc-68d5-48d7-bc59-01efc2ac9f11 is going to be updated. [ 1362.785509] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.785711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.785711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.785899] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.786044] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.786206] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b80d96cc-68d5-48d7-bc59-01efc2ac9f11" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.262982] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1363.263366] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b deletion is rescheduled due to dependency. [ 1363.263366] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.263466] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.263678] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.263859] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.263974] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.264056] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.264248] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.264341] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.264437] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.766579] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.268949] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.771078] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.771253] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.771328] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.771547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.771639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.771742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1364.802263] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.802263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.802263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.802263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.802263] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.810854] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1366.299027] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.299027] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.299027] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.299614] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.300023] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.301030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.301030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.301030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.301030] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.301030] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.301305] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.301305] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.301400] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.301463] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.301567] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.301698] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.328814] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.329013] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1366.329111] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.329298] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.329616] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-d3b54a21-3141-4311-a9dd-51c84837670a taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.329788] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.329930] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.330242] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.330402] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b54a21-3141-4311-a9dd-51c84837670a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.821460] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1366.821719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.821901] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.822196] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.822397] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.822529] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.822605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.822789] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.822887] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.823017] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.823138] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.832903] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.833132] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.833284] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.833546] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.833710] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.834030] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.834218] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.834377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.834614] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.834773] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.835119] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.835302] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.835437] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.835666] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.835804] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.835946] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: d3b54a21-3141-4311-a9dd-51c84837670a is going to be updated. [ 1366.860496] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.860708] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.860839] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.861156] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.861356] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.861585] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.254649] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.255252] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1367.324872] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.542662] env[65738]: INFO networking_nsxv3.common.synchronization [req-eea09360-6650-42f2-b61c-2c7c7543962c req-0b8892da-02ad-4153-b48b-6696285bc7e8 service nova] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1367.542742] env[65738]: INFO networking_nsxv3.common.synchronization [req-eea09360-6650-42f2-b61c-2c7c7543962c req-0b8892da-02ad-4153-b48b-6696285bc7e8 service nova] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1367.542882] env[65738]: INFO networking_nsxv3.common.synchronization [req-eea09360-6650-42f2-b61c-2c7c7543962c req-0b8892da-02ad-4153-b48b-6696285bc7e8 service nova] Enqueued Resource ID: d3b54a21-3141-4311-a9dd-51c84837670a with Priority: HIGHEST for action port [ 1367.543455] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_rules [ 1367.543590] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1367.543727] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3b54a21-3141-4311-a9dd-51c84837670a with Priority: HIGHEST for action port [ 1367.543949] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.544343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.544423] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.544622] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.544720] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.545516] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.545671] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.545724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.545845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.545990] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.546110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.546171] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.546566] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.546609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.546732] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.547392] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3b54a21-3141-4311-a9dd-51c84837670a taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.547496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.547560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.547703] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.547774] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3b54a21-3141-4311-a9dd-51c84837670a',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.827458] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b: rpc.has_security_group_logging(os_id): False [ 1367.845897] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.846137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.846137] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.846325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.846416] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.846662] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.846762] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.846824] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.846976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.847064] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.847150] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1367.908081] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.908317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.908317] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.908539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.908746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.922919] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1368.049818] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.050110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.050408] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.051677] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3b54a21-3141-4311-a9dd-51c84837670a with status ACTIVE [ 1368.052359] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.052550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.052724] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.053128] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.053281] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.053568] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.053739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.053853] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.054139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.054288] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.054597] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.054759] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.054874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.055146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.055289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.055442] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3b54a21-3141-4311-a9dd-51c84837670a is going to be updated. [ 1368.086454] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.086617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.086709] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.086906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.087062] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.087365] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3b54a21-3141-4311-a9dd-51c84837670a" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.558227] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.061418] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.061691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.061691] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.061868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.061959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.062108] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e is going to be updated. [ 1369.091687] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.091991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.091991] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.092379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.092597] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.103244] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: IN_PROGRESS for 2s [ 1369.937057] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1369.937356] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.119035] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: SUCCESS [ 1371.119035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.119035] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.119512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.119512] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.119512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.119512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.119677] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.119714] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.119801] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.119891] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.622575] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.125122] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6746dc41-8838-4c36-9c99-1ff4aced686e: rpc.has_security_group_logging(os_id): False [ 1372.143863] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.144103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.144103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.144316] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.144425] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.144759] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.144846] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.144915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.145102] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.145184] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.145271] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e is going to be updated. [ 1372.206995] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.207223] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.207295] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.207570] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.207787] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.229089] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: IN_PROGRESS for 2s [ 1372.545268] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.545446] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1374.247813] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: SUCCESS [ 1374.247813] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.546664] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.547131] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.547906] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.548321] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.549104] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.549552] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.550945] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.550945] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.552358] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.552801] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.553544] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.553974] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.554686] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.555178] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.555957] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.556241] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.556775] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.557091] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.558087] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.558425] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.542827] env[65738]: INFO networking_nsxv3.common.synchronization [req-9a178a75-41fd-4bbe-b823-46531a867899 req-21dd923a-1886-459d-b0fa-7c20f34f785d tempest-ServerActionsTestJSON-334423545 tempest-ServerActionsTestJSON-334423545-project-member] Enqueued Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1423.543369] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b with Priority: HIGHEST for action security_group_members [ 1423.543773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.543898] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.543966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.544202] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.544358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.544890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.545010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.545354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.545354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.545740] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.696628] env[65738]: INFO networking_nsxv3.common.synchronization [req-0cacc3ff-2292-4354-aaeb-52d67b518e2f req-2f28dd4e-e6d6-4baf-91b5-bc7c473df4b1 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1423.696984] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6746dc41-8838-4c36-9c99-1ff4aced686e with Priority: HIGHEST for action security_group_members [ 1423.697419] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-6746dc41-8838-4c36-9c99-1ff4aced686e taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.697419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.697560] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.697639] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.697790] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.697886] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.697948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.698484] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.698587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.698680] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6746dc41-8838-4c36-9c99-1ff4aced686e',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.047901] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.048154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.048154] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.048396] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.048494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.048700] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.048805] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.048868] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.049068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.049139] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.049206] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b is going to be updated. [ 1424.083702] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.083959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.083959] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.084275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.084465] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.103641] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: IN_PROGRESS for 2s [ 1424.201569] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.201732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.201781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.202012] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.202143] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.202349] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.202451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.202515] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.202683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.202753] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.202835] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e is going to be updated. [ 1424.233943] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.234245] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.234335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.234547] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.234681] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.244375] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: IN_PROGRESS for 2s [ 1426.113955] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b in Status: SUCCESS [ 1426.113955] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b deletion is rescheduled due to dependency. [ 1426.114464] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.255823] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6746dc41-8838-4c36-9c99-1ff4aced686e in Status: SUCCESS [ 1426.256052] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6746dc41-8838-4c36-9c99-1ff4aced686e deletion is rescheduled due to dependency. [ 1426.256118] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6746dc41-8838-4c36-9c99-1ff4aced686e" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.698160] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.698574] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.616450] env[65738]: INFO networking_nsxv3.common.synchronization [None req-59d477e5-c55e-47e6-b399-2427c359e3e4 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1429.616985] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1429.617654] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.617821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.617821] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.618114] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.618205] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.695807] env[65738]: INFO networking_nsxv3.common.synchronization [None req-d4150187-13f1-43dd-8def-683392234872 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1429.696341] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1429.696641] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.696748] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.139643] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.140026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.140026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.140104] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.140167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.140263] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 already deleted. [ 1430.140348] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.140497] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.140655] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.140750] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.664400] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.664592] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.664652] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.664836] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.664977] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.665042] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 already deleted. [ 1430.665120] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.697420] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.697788] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.100071] env[65738]: INFO networking_nsxv3.common.synchronization [req-72f2fc67-27b8-4abf-8caf-f760dc3da386 req-6eddc646-85bb-4e8b-9209-f865fe52f587 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1435.100970] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1435.101330] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.101443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.101491] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.101791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.101954] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.102131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.102200] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.102405] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.102532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.102643] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.344880] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.345171] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.345303] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.345564] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.345834] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.345987] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.346115] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.346319] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.346460] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.346676] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1435.346815] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1435.346936] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1435.347079] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1435.347235] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1435.347368] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1435.347571] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1435.369363] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1435.369551] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1435.369661] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1435.369843] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.370191] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-2f54c8fc-bf38-47b5-896e-569f5ed27f34 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.370380] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.370500] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.370947] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.371123] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f54c8fc-bf38-47b5-896e-569f5ed27f34',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.604959] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.605164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.605164] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.605379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.605605] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.605826] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.605981] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.606081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.606276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.606375] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.606480] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 already deleted. [ 1435.606583] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.874763] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.875169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.875169] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.875377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.875526] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.875682] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Segment Port 2f54c8fc-bf38-47b5-896e-569f5ed27f34 not found, creating... [ 1435.875936] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.876105] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.876230] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.876441] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.876574] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.876855] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.877066] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.877142] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.877326] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.877455] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.877592] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 is going to be created. [ 1435.901522] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.901733] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.901836] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.902095] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.902326] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.902584] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.567146] env[65738]: INFO networking_nsxv3.common.synchronization [req-72f2fc67-27b8-4abf-8caf-f760dc3da386 req-51555ffc-4af4-4517-963d-50fa97e84de2 service nova] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1436.567346] env[65738]: INFO networking_nsxv3.common.synchronization [req-72f2fc67-27b8-4abf-8caf-f760dc3da386 req-51555ffc-4af4-4517-963d-50fa97e84de2 service nova] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1436.567484] env[65738]: INFO networking_nsxv3.common.synchronization [req-72f2fc67-27b8-4abf-8caf-f760dc3da386 req-51555ffc-4af4-4517-963d-50fa97e84de2 service nova] Enqueued Resource ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with Priority: HIGHEST for action port [ 1436.567980] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1436.568482] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1436.568598] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with Priority: HIGHEST for action port [ 1436.568870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.568989] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.569068] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.569265] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.569348] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.570123] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.570230] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.570299] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.570684] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.570837] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.570934] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.570996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.571157] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.571275] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.571314] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.572029] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f54c8fc-bf38-47b5-896e-569f5ed27f34 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.572115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.572183] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.572336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.572410] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f54c8fc-bf38-47b5-896e-569f5ed27f34',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.074265] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.075205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.075320] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.075509] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with status ACTIVE [ 1437.075688] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.075790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.075835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.076057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.076150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.076323] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.076418] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.076475] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.076627] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.076727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.076946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.077070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.077131] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.077274] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.077347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.077430] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 is going to be updated. [ 1437.098038] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.098228] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.098270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.098468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.098603] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.098755] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.579801] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.083130] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.083130] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.083593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.083593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.083593] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.083692] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be created. [ 1438.109641] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.109799] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.109869] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.110080] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.110243] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.119565] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: UNINITIALIZED for 2s [ 1440.131052] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1440.131479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.131479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.131479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.131710] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.131843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.131843] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.131958] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.132039] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.132146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.132227] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.635297] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.138215] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dfb4cba-ce39-484d-953e-34e1d56194c1: rpc.has_security_group_logging(os_id): False [ 1441.156408] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.156618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.156618] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.156818] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.156904] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.157160] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.157261] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.157322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.157479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.157554] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.157648] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be created. [ 1441.215684] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.215945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.215945] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.216136] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.216312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.227016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: IN_PROGRESS for 2s [ 1441.570037] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.570250] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1443.240282] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1443.240607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.571471] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.571907] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.573062] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.573510] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.574873] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.574873] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.576431] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.576855] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.577967] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.578392] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.579354] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.579693] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.580401] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.580847] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.939959] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1479.939959] env[65738]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-41b00c14-c386-4d67-93e2-7bd6302aacd7 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1481.581675] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.581675] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.582560] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.583027] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.584127] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.584583] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.585431] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.585882] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.586457] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.586886] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.587868] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.588262] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.881382] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.881835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.881835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.881835] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.881953] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.263931] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.264195] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.264349] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.264638] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.264966] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.265174] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.265308] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.265557] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.265742] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.265982] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1509.266141] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] NeedRegenerationException {{(pid=65738) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1509.266258] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] no value, waiting for create lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1509.266391] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] value creation lock acquired {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1509.266521] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] No value present for key: 'zone-id' {{(pid=65738) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1509.266664] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Calling creation function for not-yet-present value {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1509.266833] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1509.315755] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1509.315977] env[65738]: DEBUG dogpile.cache.region [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=65738) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1509.316057] env[65738]: DEBUG dogpile.lock [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Released creation lock {{(pid=65738) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1509.316241] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "network-780" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.316564] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock port-2f54c8fc-bf38-47b5-896e-569f5ed27f34 taken with stack trace [, , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.316741] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.316861] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.317161] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.317296] env[65738]: DEBUG networking_nsxv3.api.rpc [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f54c8fc-bf38-47b5-896e-569f5ed27f34',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.384448] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.819894] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.820223] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.820293] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.820542] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.820689] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.820986] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.821156] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.821271] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.821481] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.821612] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.821893] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.822061] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.822178] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.822377] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.822510] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.822661] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Resource: SegmentPort with ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 is going to be updated. [ 1509.846786] env[65738]: DEBUG networking_nsxv3.common.locking [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.847042] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.847165] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.847435] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.847626] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.847881] env[65738]: DEBUG oslo_concurrency.lockutils [None req-413bdf9f-1bf3-4a42-8ed2-65b0e2ebe432 None None] Releasing lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.886590] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.388697] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1510.388862] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1510.503387] env[65738]: INFO networking_nsxv3.common.synchronization [req-30479c2d-49ba-4cd2-b193-54c223d566df req-a9b54be2-9886-4531-acfc-e86fd1f29a28 service nova] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1510.503561] env[65738]: INFO networking_nsxv3.common.synchronization [req-30479c2d-49ba-4cd2-b193-54c223d566df req-a9b54be2-9886-4531-acfc-e86fd1f29a28 service nova] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1510.503700] env[65738]: INFO networking_nsxv3.common.synchronization [req-30479c2d-49ba-4cd2-b193-54c223d566df req-a9b54be2-9886-4531-acfc-e86fd1f29a28 service nova] Enqueued Resource ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with Priority: HIGHEST for action port [ 1510.504284] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_rules [ 1510.504421] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1510.504517] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with Priority: HIGHEST for action port [ 1510.504892] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.505008] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.505522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.505833] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.505946] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.506829] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.506940] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.507018] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.507186] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.507574] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.507702] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.507830] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.507988] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.508094] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.508183] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.511119] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f54c8fc-bf38-47b5-896e-569f5ed27f34 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.511119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.511119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.511119] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.511119] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f54c8fc-bf38-47b5-896e-569f5ed27f34',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.010546] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.011377] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.011476] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.011848] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f54c8fc-bf38-47b5-896e-569f5ed27f34 with status ACTIVE [ 1511.012033] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.012146] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.012214] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.012414] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.012532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.012701] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.012827] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.012890] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.013066] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.013145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.013332] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.013415] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.013468] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.013858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.013858] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.013858] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f54c8fc-bf38-47b5-896e-569f5ed27f34 is going to be updated. [ 1511.056150] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.056358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.056358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.056522] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.056648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.056817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f54c8fc-bf38-47b5-896e-569f5ed27f34" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.263955] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.264259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.264259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.264533] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.278425] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1511.279539] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.280910] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1511.328442] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.328650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.328650] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.328882] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.342711] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.343645] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1511.343736] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1511.343814] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1511.388828] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.389025] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.389070] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.389291] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.389954] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.390124] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1511.496118] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.496441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.496441] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.496584] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.496834] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.497155] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1511.512672] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.586449] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.586778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.586778] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.586928] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.587163] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.587444] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1511.587528] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8b62a35a-29b0-4826-a035-6eed21356980', '5d9a650f-180d-4827-8a8a-cdff5aa50644', 'ad710818-9f6b-4718-bff8-4836e8a61c3b', '194d1d45-daf3-4873-a0c4-a279f2704021', '13e04b13-1f3c-4f36-a68f-be19736a3742', '2b8b178e-30ff-4875-afce-3f12db8c8904', '93ac889c-a70d-42e4-9f0a-90c362835c16', '47750d4b-22bd-42e5-bf36-3cc17e08c0a0', '0dfb4cba-ce39-484d-953e-34e1d56194c1', 'ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05', 'f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee', 'ac1c642a-c375-4b06-8293-de7939b50479', '11be5bab-0ed1-4fcd-8cd0-a3658db651bc', '2b5f20e7-94a1-4514-adde-54a6960390c3', 'da85289d-08d2-4040-ba9b-31d7eea34c68', '21f8f014-13fa-4be1-97eb-834dadab33fd', '1cea2a24-1c24-47dc-87cf-758c1ad81488', '0abfdb06-6f7f-40a7-be5b-fa4298901330', '7e040984-bcc9-43b0-a9c8-bbd4511a7fc1', 'a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c', '5d496eb2-c9c3-4ebf-a96b-92344b1e1e6b', '198f2d52-4200-42b2-be51-13b90ddae50d', '6746dc41-8838-4c36-9c99-1ff4aced686e', '33ab54d8-f174-4187-9e64-2cd39cd90273', '60fa81d8-8f48-4912-b0e6-1cff6e6ccdff', '89618efc-1c71-4f3b-9cfc-d651fcf1fe99'} {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1511.587644] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1511.608680] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.609032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.609032] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.609224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.609224] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.609323] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1511.609371] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1511.609432] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1511.691916] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.692236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.692236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.692389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.693537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.693793] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1511.693876] env[65738]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65738) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1511.693940] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1511.694050] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1511.694146] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1511.694218] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGH for action security_group_rules [ 1511.694298] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGH for action security_group_rules [ 1511.694355] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGH for action security_group_rules [ 1511.694418] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGH for action security_group_rules [ 1511.694471] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGH for action security_group_rules [ 1511.694526] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGH for action security_group_rules [ 1511.694579] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGH for action security_group_rules [ 1511.694637] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGH for action security_group_rules [ 1511.694688] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGH for action security_group_rules [ 1511.694746] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGH for action security_group_rules [ 1511.694830] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGH for action security_group_rules [ 1511.694914] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGH for action security_group_rules [ 1511.694964] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGH for action security_group_rules [ 1511.695312] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGH for action security_group_rules [ 1511.695609] env[65738]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGH for action security_group_rules [ 1511.695609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.015268] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.015738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.015738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.015738] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.015867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.015867] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be updated. [ 1512.056739] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.057033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.057033] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.057289] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.057602] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.066728] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: IN_PROGRESS for 2s [ 1514.078130] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1514.078563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.078563] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.078859] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.079099] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.079256] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.079346] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.079532] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.079637] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.079746] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.079859] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.582469] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.085314] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dfb4cba-ce39-484d-953e-34e1d56194c1: rpc.has_security_group_logging(os_id): False [ 1515.106181] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.106438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.106438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.106647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.128927] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.129257] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.129395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.129514] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.129634] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.129719] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.129799] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be updated. [ 1515.199614] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.199896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.199896] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.200219] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.200270] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.216826] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: IN_PROGRESS for 2s [ 1515.505847] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.505847] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1515.506189] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b62a35a-29b0-4826-a035-6eed21356980 with Priority: HIGH for action security_group_rules [ 1515.506189] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad710818-9f6b-4718-bff8-4836e8a61c3b with Priority: HIGH for action security_group_rules [ 1515.506189] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 with Priority: HIGH for action security_group_rules [ 1515.506333] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da85289d-08d2-4040-ba9b-31d7eea34c68 with Priority: HIGH for action security_group_rules [ 1515.506384] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c with Priority: HIGH for action security_group_rules [ 1515.506518] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 with Priority: HIGH for action security_group_rules [ 1515.506788] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 with Priority: HIGH for action security_group_rules [ 1515.506788] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 with Priority: HIGH for action security_group_rules [ 1515.506788] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 with Priority: HIGH for action security_group_rules [ 1515.506788] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f8f014-13fa-4be1-97eb-834dadab33fd with Priority: HIGH for action security_group_rules [ 1515.507116] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc with Priority: HIGH for action security_group_rules [ 1515.507116] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1c642a-c375-4b06-8293-de7939b50479 with Priority: HIGH for action security_group_rules [ 1515.507116] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee with Priority: HIGH for action security_group_rules [ 1515.507116] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 with Priority: HIGH for action security_group_rules [ 1515.507405] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGH for action security_group_rules [ 1515.507405] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 with Priority: HIGH for action security_group_rules [ 1515.507405] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 with Priority: HIGH for action security_group_rules [ 1515.507620] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 with Priority: HIGH for action security_group_rules [ 1515.507620] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 with Priority: HIGH for action security_group_rules [ 1515.507620] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194d1d45-daf3-4873-a0c4-a279f2704021 with Priority: HIGH for action security_group_rules [ 1515.507964] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b62a35a-29b0-4826-a035-6eed21356980 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.508110] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.508162] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.508471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.508471] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b62a35a-29b0-4826-a035-6eed21356980',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.509661] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad710818-9f6b-4718-bff8-4836e8a61c3b taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.509783] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.509867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.510086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.510177] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad710818-9f6b-4718-bff8-4836e8a61c3b',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.510946] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ac889c-a70d-42e4-9f0a-90c362835c16 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.511112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.511112] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.511300] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.512091] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ac889c-a70d-42e4-9f0a-90c362835c16',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.512091] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da85289d-08d2-4040-ba9b-31d7eea34c68 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.512520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.512520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.512520] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.512520] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da85289d-08d2-4040-ba9b-31d7eea34c68',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.513503] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.513503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.513503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.513725] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.513725] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.515314] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.515314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.515314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.515314] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.515314] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e040984-bcc9-43b0-a9c8-bbd4511a7fc1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.516192] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0abfdb06-6f7f-40a7-be5b-fa4298901330 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.516192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.516192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.516192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.516455] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0abfdb06-6f7f-40a7-be5b-fa4298901330',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.516930] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cea2a24-1c24-47dc-87cf-758c1ad81488 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.517113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.517113] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.517723] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.517723] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cea2a24-1c24-47dc-87cf-758c1ad81488',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.518176] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5f20e7-94a1-4514-adde-54a6960390c3 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.518176] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.518700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.518700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.518700] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5f20e7-94a1-4514-adde-54a6960390c3',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.519262] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f8f014-13fa-4be1-97eb-834dadab33fd taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.519262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.519262] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.519503] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.519503] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f8f014-13fa-4be1-97eb-834dadab33fd',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.520124] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.520250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.520307] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.520407] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.520474] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11be5bab-0ed1-4fcd-8cd0-a3658db651bc',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.521267] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac1c642a-c375-4b06-8293-de7939b50479 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.521397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.521397] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.521512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.521716] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac1c642a-c375-4b06-8293-de7939b50479',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.522235] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.522395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.522395] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.522575] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.522648] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.523275] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.523768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.523768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.523768] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.523768] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.524562] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.524562] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.524694] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b178e-30ff-4875-afce-3f12db8c8904 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.524765] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.524808] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.524965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.525078] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b178e-30ff-4875-afce-3f12db8c8904',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.525845] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.525845] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.526034] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.526494] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.526494] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47750d4b-22bd-42e5-bf36-3cc17e08c0a0',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.527098] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13e04b13-1f3c-4f36-a68f-be19736a3742 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.527098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.527098] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.527336] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.527336] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13e04b13-1f3c-4f36-a68f-be19736a3742',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.527983] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d9a650f-180d-4827-8a8a-cdff5aa50644 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.528103] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.528167] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.528311] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.528376] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d9a650f-180d-4827-8a8a-cdff5aa50644',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.529044] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194d1d45-daf3-4873-a0c4-a279f2704021 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.529276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.529276] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.529454] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.529454] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194d1d45-daf3-4873-a0c4-a279f2704021',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.557224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.557398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.557398] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.557814] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.559493] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.559617] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.584189] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.584437] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ac889c-a70d-42e4-9f0a-90c362835c16 is going to be deleted. [ 1515.585983] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.586209] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.611976] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.612199] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b62a35a-29b0-4826-a035-6eed21356980 is going to be deleted. [ 1515.679755] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.680015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.680015] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.680215] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.680323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.680486] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ac889c-a70d-42e4-9f0a-90c362835c16" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.681541] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.681683] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.681730] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.681935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.682049] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.682187] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b62a35a-29b0-4826-a035-6eed21356980" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.086297] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.086775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.086775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.086775] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.101843] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.102086] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.102922] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.103038] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.103773] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.103872] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.104669] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.104754] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.105540] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.105659] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.106334] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.106419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.112065] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.112197] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.118224] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.118364] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.119075] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.119179] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.119848] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.119939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.121251] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.121785] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.121877] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.122471] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.122870] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.122965] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.123612] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.123997] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.124142] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.124716] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.125133] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.125259] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.125441] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.125891] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.126031] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.126717] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.127196] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.127323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.127854] env[65738]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1516.128322] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.128432] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da85289d-08d2-4040-ba9b-31d7eea34c68 is going to be deleted. [ 1516.129641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.129641] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.148309] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.148487] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47750d4b-22bd-42e5-bf36-3cc17e08c0a0 is going to be deleted. [ 1516.149323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.149647] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.169493] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.169712] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad710818-9f6b-4718-bff8-4836e8a61c3b is going to be deleted. [ 1516.170568] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.170771] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.194534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.194742] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac1c642a-c375-4b06-8293-de7939b50479 is going to be deleted. [ 1516.195648] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.195874] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.212360] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.212614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.216867] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.216997] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d9a650f-180d-4827-8a8a-cdff5aa50644 is going to be deleted. [ 1516.218010] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.218235] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.237115] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.237287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.240617] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.240721] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.244381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.244536] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05 is going to be deleted. [ 1516.245490] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.245708] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.269968] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.270169] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13e04b13-1f3c-4f36-a68f-be19736a3742 is going to be deleted. [ 1516.271144] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.271451] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.312213] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.312508] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.321567] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.321769] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.337087] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.337280] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0abfdb06-6f7f-40a7-be5b-fa4298901330 is going to be deleted. [ 1516.338273] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.338537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.381369] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.381607] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.382323] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.382443] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b178e-30ff-4875-afce-3f12db8c8904 is going to be deleted. [ 1516.383389] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.383596] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.421777] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.421999] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.521354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.521548] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f8f014-13fa-4be1-97eb-834dadab33fd is going to be deleted. [ 1516.522604] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.522837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.524469] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.524595] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.525792] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.525946] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.549089] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.549286] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e040984-bcc9-43b0-a9c8-bbd4511a7fc1 is going to be deleted. [ 1516.550303] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.550534] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.595612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.595824] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11be5bab-0ed1-4fcd-8cd0-a3658db651bc is going to be deleted. [ 1516.596812] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.597115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.637176] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.637394] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.770382] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.770581] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5f20e7-94a1-4514-adde-54a6960390c3 is going to be deleted. [ 1516.771614] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.771781] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.798443] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.798642] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194d1d45-daf3-4873-a0c4-a279f2704021 is going to be deleted. [ 1516.799790] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.800042] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.842324] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.842550] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.843303] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.843428] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.882340] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.882519] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee is going to be deleted. [ 1516.883581] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.883871] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.950512] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.950686] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cea2a24-1c24-47dc-87cf-758c1ad81488 is going to be deleted. [ 1516.951773] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.952043] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.953713] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.953817] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.038182] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.038397] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c is going to be deleted. [ 1517.039372] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.039657] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.039758] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.039894] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da85289d-08d2-4040-ba9b-31d7eea34c68" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.040133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.040310] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.040391] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.040504] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad710818-9f6b-4718-bff8-4836e8a61c3b" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.041127] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.041325] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.041444] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.041552] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47750d4b-22bd-42e5-bf36-3cc17e08c0a0" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.041700] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.041866] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.041933] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.042115] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac1c642a-c375-4b06-8293-de7939b50479" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.042250] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.042403] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.042479] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.042616] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d9a650f-180d-4827-8a8a-cdff5aa50644" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.042767] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.042939] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.043013] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.043145] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed2d3e39-7c98-4dfb-8316-e9ee6aa09b05" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.043312] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.043419] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.043492] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.043606] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13e04b13-1f3c-4f36-a68f-be19736a3742" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.043739] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.043875] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.043948] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.044081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b178e-30ff-4875-afce-3f12db8c8904" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.044220] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.044354] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.044432] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.044545] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0abfdb06-6f7f-40a7-be5b-fa4298901330" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.044672] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.044810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.044921] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.045057] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f8f014-13fa-4be1-97eb-834dadab33fd" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.045192] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.045335] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.045410] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.045546] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11be5bab-0ed1-4fcd-8cd0-a3658db651bc" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.045727] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.045902] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.045962] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.046081] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e040984-bcc9-43b0-a9c8-bbd4511a7fc1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.046217] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.046358] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.046431] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.046537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5f20e7-94a1-4514-adde-54a6960390c3" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.085779] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.086059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.086059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.086287] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.086378] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.086612] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194d1d45-daf3-4873-a0c4-a279f2704021" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.126313] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.126537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.126537] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.126722] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.126810] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.126935] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3d9b4bb-23ef-4ad0-974d-bea5e4f5c1ee" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.139999] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.140236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.140236] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.140471] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.140557] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.140680] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cea2a24-1c24-47dc-87cf-758c1ad81488" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.155248] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.155510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.155510] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.155689] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.155780] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.155907] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9cca76f-b18e-40d1-a93c-3ddefd3cbb2c" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.275739] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1517.276053] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.276342] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.276609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.276706] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.780218] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.780218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.780218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.780218] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.780521] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.780969] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.781126] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.781379] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.781535] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.781631] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.781719] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.284442] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1518.787138] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dfb4cba-ce39-484d-953e-34e1d56194c1: rpc.has_security_group_logging(os_id): False [ 1518.804880] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.805150] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.805203] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.805462] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.805587] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.805879] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.805996] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.806083] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.806283] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.806362] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.806486] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be updated. [ 1518.868603] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.868837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.868837] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.868966] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.869133] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.888593] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: IN_PROGRESS for 2s [ 1520.508918] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.509384] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1520.908162] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1520.908343] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.509956] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.510339] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.510625] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.510989] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.512195] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.512609] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.513956] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.514383] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.515390] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.515855] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.517333] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.517742] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.518397] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.518787] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.520398] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.520796] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.452176] env[65738]: INFO networking_nsxv3.common.synchronization [req-670b804b-0228-4690-a9d3-e2b6200dc662 req-efc8290a-e6b1-44d7-968f-a7ce0196cb31 tempest-AttachVolumeShelveTestJSON-605300813 tempest-AttachVolumeShelveTestJSON-605300813-project-member] Enqueued Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1561.452861] env[65738]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 with Priority: HIGHEST for action security_group_members [ 1561.453269] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dfb4cba-ce39-484d-953e-34e1d56194c1 taken with stack trace [, , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.453347] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.453438] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.453640] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.453814] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.453944] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.454026] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.454201] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.454304] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.454415] env[65738]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dfb4cba-ce39-484d-953e-34e1d56194c1',) {} {{(pid=65738) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.959205] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.959791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.959791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.959791] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.960059] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.960220] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.960381] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.960496] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.960732] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.960839] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.960986] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 is going to be updated. [ 1561.998358] env[65738]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65738) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.998609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.998609] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.998761] env[65738]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.998906] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.008016] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: IN_PROGRESS for 2s [ 1564.019532] env[65738]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 in Status: SUCCESS [ 1564.019915] env[65738]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dfb4cba-ce39-484d-953e-34e1d56194c1 deletion is rescheduled due to dependency. [ 1564.019915] env[65738]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dfb4cba-ce39-484d-953e-34e1d56194c1" {{(pid=65738) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.453713] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.454159] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.454657] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.454940] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.455630] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.456137] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.457501] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.457941] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.458896] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.459314] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.460783] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.461325] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.462410] env[65738]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.462767] env[65738]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0